CentOS7下部署CDH5.9(HA)
文件下载
Cloudera Manager
http://archive.cloudera.com/cm5/cm/5/cloudera-manager-centos7-cm5.9.0_x86_64.tar.gz
CDH安装包
地址:http://archive.cloudera.com/cdh5/parcels/5.9.0/
本文基于CentOS7,下载的parcels包及manifest文件对应的版本为el7:
CDH-5.9.0-1.cdh5.9.0.p0.23-el7.parcel
CDH-5.9.0-1.cdh5.9.0.p0.23-el7.parcel.sha1
manifest.json
JDBC
http://download.softagency.net/MySQL/Downloads/Connector-J/mysql-connector-java-5.1.42.tar.gz
JDBC目前已经有6.x,但与CDH 5.x存在不兼容
环境搭建
master1-2 28G内存 6核 800G硬盘
worker1-2 24G内存 4核 800G硬盘
网络配置(所有节点)
修改主机名:
# vi /etc/hostname
hadoop-master1
或者
# hostnamectl set-hostname hadoop-master1
查看hostname
# hostname
配置ip地址
# vi /etc/sysconfig/network-scripts/ifcfg-eth33/
TYPE=Ethernet
BOOTPROTO=static # 设置为静态
DEFROUTE=yes
PEERDNS=yes
PEERROUTES=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
IPV6_FAILURE_FATAL=no
IPV6_ADDR_GEN_MODE=stable-privacy
NAME=ens33
DEVICE=ens33
ONBOOT=yes # 开机启用
IPADDR=xxx.x
yesI/ /hostname/hadoop-master1/核 /800/内存/vi/配置/硬盘/
yesI/ /hostname/hadoop-master1/核 /800/内存/vi/配置/硬盘/
-->