通过Cloudera Manager部署CDH5.15.1的webUI界面详解

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　 　　作者：尹正杰

版权声明：原创作品，谢绝转载！否则将追究法律责任。

　　本篇博客CDH的部署完全通过Cloudera Manager的webUI的安装向导来完成的，关于CM的部署详情请参考：https://www.cnblogs.com/yinzhengjie/p/9495964.html。

一.安装CHD的服务

1>.CM的webUI界面默认的用户名/密码都是小写的admin,我们输入用户名和密码进行登录。操作如下：

2>.同一CM的协议，点击继续

3>.选择CM的免费版本

4>.点击继续

5>.为 CDH 群集安装指定主机

6>.选择CDH本地版本（即我们自己下载好的版本）

7>.CDH的默认存放路径介绍

8>.当CDH安装完毕后，点击继续

9>.等待检查主机完成

10>.我们可以根据下面的提示去相应的服务器做具体的操作，做完操作后点击“重新运行”以验证你是否配置成功！

11>.解决告警信息后，点击完成

[root@node101 ~]# xcall.sh date -R

============= node101.yinzhengjie.org.cn : date -R ============

Thu,  Sep  :: +

命令执行成功

============= node102.yinzhengjie.org.cn : date -R ============

Thu,  Sep  :: +

命令执行成功

============= node103.yinzhengjie.org.cn : date -R ============

Thu,  Sep  :: +

命令执行成功

[root@node101 ~]#

验证时区是否修改过来了（[root@node101 ~]# xcall.sh date -R）

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"

============= node101.yinzhengjie.org.cn : echo  > /proc/sys/vm/swappiness ============

命令执行成功

============= node102.yinzhengjie.org.cn : echo  > /proc/sys/vm/swappiness ============

命令执行成功

============= node103.yinzhengjie.org.cn : echo  > /proc/sys/vm/swappiness ============

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh cat /proc/sys/vm/swappiness

============= node101.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============

命令执行成功

============= node102.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============

命令执行成功

============= node103.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"

============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============

命令执行成功

============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============

命令执行成功

============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh cat  /sys/kernel/mm/transparent_hugepage/defrag

============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============

always madvise [never]

命令执行成功

============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============

always madvise [never]

命令执行成功

============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============

always madvise [never]

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag"

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"

============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============

命令执行成功

============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============

命令执行成功

============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh "cat /sys/kernel/mm/transparent_hugepage/enabled"

============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============

always madvise [never]

命令执行成功

============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============

always madvise [never]

命令执行成功

============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============

always madvise [never]

命令执行成功

[root@node101 ~]#

[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled"

12>.自定义需要安装的服务

13>.分配角色

14>.等待审核

15>.集群设置

16>.等待安装完成

17>.完成安装后，点击继续

18>.CDH部署成功界面

19>.进入CDH主界面

 二.验证CHD服务是否可用

1>.验证zookeeper是否可以正常使用

[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn

Connecting to node101.yinzhengjie.org.cn

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:zookeeper.version=3.4.-cdh5.15.1--, built on // : GMT

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:host.name=node101.yinzhengjie.org.cn

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:java.version=1.8.0_131

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:java.vendor=Oracle Corporation

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:java.home=/soft/jdk1..0_131/jre

-- ::, [myid:] - INFO  [main:Environment@] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.-.cdh5.15.1.p0./lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar

2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.io.tmpdir=/tmp

2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:java.compiler=<NA>

2018-09-15 11:26:03,630 [myid:] - INFO  [main:Environment@100] - Client environment:os.name=Linux

2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.arch=amd64

2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64

2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.name=root

2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.home=/root

2018-09-15 11:26:03,631 [myid:] - INFO  [main:Environment@100] - Client environment:user.dir=/root

2018-09-15 11:26:03,632 [myid:] - INFO  [main:ZooKeeper@438] - Initiating client connection, connectString=node101.yinzhengjie.org.cn sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@506c589e

Welcome to ZooKeeper!

2018-09-15 11:26:03,650 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@975] - Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error)

JLine support is enabled

2018-09-15 11:26:03,710 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@852] - Socket connection established, initiating session, client: /172.30.1.101:60205, server: node101.yinzhengjie.org.cn/172.30.1.101:2181

2018-09-15 11:26:03,720 [myid:] - INFO  [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x265db13b97d0001, negotiated timeout = 30000

WATCHER::

WatchedEvent state:SyncConnected type:None path:null

[zk: node101.yinzhengjie.org.cn(CONNECTED) 0]

登录zookeeper集群（[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn Connecting to node101.yinzhengjie.org.cn）

[zk: node101.yinzhengjie.org.cn(CONNECTED) ] ls /

[zookeeper]

[zk: node101.yinzhengjie.org.cn(CONNECTED) ] quit

Quitting...

-- ::, [myid:] - INFO  [main:ZooKeeper@] - Session: 0x265db13b97d0001 closed

-- ::, [myid:] - INFO  [main-EventThread:ClientCnxn$EventThread@] - EventThread shut down

You have new mail in /var/spool/mail/root

[root@node101 ~]#

[root@node101 ~]#

2>.查看hdfs目录信息（注意权限，如果你想要往指定目录写数据的话，可以指定ACL）

[root@node101 ~]# hdfs dfs -ls -R /

drwxrwxrwt   - hdfs supergroup           -- : /tmp

drwxrwxrwt   - mapred hadoop               -- : /tmp/logs

drwxr-xr-x   - hdfs   supergroup           -- : /user

drwxrwxrwx   - mapred hadoop               -- : /user/history

drwxrwx---   - mapred hadoop               -- : /user/history/done

ls: Permission denied: user=root, access=READ_EXECUTE, inode="/user/history/done":mapred:hadoop:drwxrwx---

drwxrwxrwt   - mapred hadoop               -- : /user/history/done_intermediate

[root@node101 ~]#

3>.查看hdfs的webUI界面

　　查看hdfs的界面如下，试试有种似曾相识的感脚？

最新文章

  1. 福利到！Rafy(原OEA)领域实体框架 2.22.2067 发布！
  2. 算法是什么我记不住，But i do it my way. （二）
  3. JS组件系列——Bootstrap Table 表格行拖拽（二：多行拖拽）
  4. CSS布局技巧 -- 各种居中
  5. 【java】spring-data-jpa 集成hibernate实现多条件分页查询
  6. 解决apache AH01630: client denied by server configuration错误
  7. ListView美化：去阴影、底色、选中色
  8. 武汉科技大学ACM ：1002: A+B for Input-Output Practice (II)
  9. IntelliJ IDEA的激活和汉化
  10. PHP 注释 数据类型 变量的定义/输出 类型的获取/转换 可变变量
  11. C# 使用SmtpClient发送Email
  12. 剑指offer 4.树 重建二叉树
  13. SVN与Git比较的优缺点差异
  14. bootgrid修改成可以全勾选和全取消勾选操作
  15. 【Linux】CentOs中yum与rpm区别
  16. 完全卸载oraclean安装
  17. Java中包的介绍
  18. EBS标准的查看供应商地点
  19. php三种方法从控制结构或脚本中跳出
  20. Python【异常处理】

热门文章

  1. 读书笔记（chapter17）
  2. 基于UML的需求分析和系统设计
  3. Maven入门指南④：仓库
  4. Linux养成笔记
  5. eclipse repository connector
  6. webstrom 安装Babel
  7. Node 连接池pool
  8. Java DateUtils 的实用
  9. int ,Intege,String 三者之间的转换
  10. aop 记录用户操作（一）