手工安装¶
仓库¶
# 官方Parcels仓库:
# https://archive.cloudera.com/cdh6/6.1.0/parcels/
#
# Cloudera-Manger仓库:
# https://archive.cloudera.com/cm6/6.1.0/redhat7/yum/
#
# 内网仓库:
# http://172.24.26.90:57777/cdh/6.1.0/
# http://172.24.26.90:57777/cloudera-manager/6.1.0/
# 需要注意,无论使用内网和官方仓库注册都要使用执行,rpm命令注册仓库
rpm --import https://archive.cloudera.com/cm6/6.1.0/redhat7/yum/RPM-GPG-KEY-cloudera
rpm --import https://archive.cloudera.com/cm6/6.1.0/redhat7/yum/RPM-GPG-KEY-cloudera
安装¶
安装三节点集群。
| 主机名 | Role | 备注 |
|---|---|---|
| rjbdnode1 | cm、mariadb、agent | 172.24.26.102 |
| rjbdnode2 | agent | 172.24.26.103 |
| rjbdnode3 | agent | 172.24.26.104 |
前期工作(所有节点)¶
# 关防火墙
setenforce 0
systemctl stop firewalld
systemctl disable firewalld
# 装JDK
安装MariaDB¶
yum -y install mariadb-server
systemctl enable mariadb
systemctl start mariadb
# 执行 /usr/bin/mysql_secure_installation 初始化化数据库
# 执行以下sql允许root用户远程访问
# GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'rjbigdata' WITH GRANT OPTION;
# 执行以下SQL创建DB
# CREATE DATABASE scm DEFAULT CHARACTER SET utf8 DEFAULT COLLATE utf8_general_ci;
注意:Cloudera 给出了一个MariaDB的官方推荐配置,请参考。
安装Cloudera应用¶
# 所有节点安装mysql的JDBC驱动,执行以下代码
wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.47.tar.gz
tar zxvf mysql-connector-java-5.1.47.tar.gz
mkdir -p /usr/share/java/
cd mysql-connector-java-5.1.47
cp mysql-connector-java-5.1.47-bin.jar /usr/share/java/mysql-connector-java.jar
# 安装rjbdnode1 执行
yum install -y cloudera-manager-server
# 在rjbdnode1 同步数据库配置
/opt/cloudera/cm/schema/scm_prepare_database.sh mysql -h rjbdnode1 --scm-host rjbdnode1 scm root rjbigdata
# 启动CM
systemctl enable cloudera-scm-server
systemctl start cloudera-scm-server
# 所有节点执行以下操作
yum install -y cloudera-manager-agent
# 修改 /etc/cloudera-scm-agent/config.ini 中的 server_host 为 rjbdnode1
# 启动AGENT
systemctl enable cloudera-scm-agent
systemctl start cloudera-scm-agent
创建集群¶
登录CM创建集群,略。