hadoop2.7.7 测试安装 centos7
useradd –m hadoop –s /bin/bash
hadoop ALL=(ALL) ALL
chmod u-w /etc/sudoers
安装路径/hadoop-2.7.7/etc/hadoop/hadoop-env.sh
安装路径/hadoop-2.7.7/etc/hadoop/yarn-env.sh
安装路径/hadoop-2.7.7/etc/hadoop/slaves
安装路径/hadoop-2.7.7/etc/hadoop/core-site.xml
安装路径/hadoop-2.7.7/etc/hadoop/hdfs-site.xml
安装路径/hadoop-2.7.7/etc/hadoop/mapred-site.xml
安装路径/hadoop-2.7.7/etc/hadoop/yarn-site.xml
===
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:8020</value>
</property>
<property>
<name>io.file.buffer.size</name>
<value>131072</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>file:/home/hadoop/tmp</value>
<description>Abase for other temporary directories.</description>
</property>
<property>
<name>hadoop.proxyuser.hadoop.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hadoop.groups</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.root.groups</name>
<value>*</value>
<description>Allow the superuser oozie to impersonate any members of the group group1 and group2</description>
</property>
<property>
<name>hadoop.proxyuser.root.hosts</name>
<value>*</value>
<description>The superuser can connect only from host1 and host2 to impersonate a user</description>
</property>
</configuration>
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.namenode.secondary.http-address</name>
<value>localhost:9001</value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>file:/home/hadoop/dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>file:/home/hadoop/dfs/data</value>
</property>
<property>
<name>dfs.replication</name>
<value>3</value>
</property>
<property>
<name>dfs.webhdfs.enabled</name>
<value>true</value>
</property>
</configuration>
===
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.jobhistory.address</name>
<value>localhost:10020</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>localhost:19888</value>
</property>
</configuration>
=======
<?xml version="1.0"?>
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>localhost:8032</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>localhost:8030</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>localhost:8031</value>
</property>
<property>
<name>yarn.resourcemanager.admin.address</name>
<value>localhost:8033</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>localhost:8088</value>
</property>
</configuration>
====
Starting namenodes on [localhost]
localhost: starting namenode, logging to /usr/local/hadoop/hadoop-2.7.7/logs/hadoop-hadoop-namenode-mhc-linux.out
localhost: starting datanode, logging to /usr/local/hadoop/hadoop-2.7.7/logs/hadoop-hadoop-datanode-mhc-linux.out
Starting secondary namenodes [localhost]
localhost: starting secondarynamenode, logging to /usr/local/hadoop/hadoop-2.7.7/logs/hadoop-hadoop-secondarynamenode-mhc-linux.out
ulimit -a for user root
stop-dfs.sh
这里我们直接重新格式化namenode,然后启动namenode就可以了
hadoop namenode -format
$ start-dfs.sh
ps -ef|grep node
有三个进程
proc_namenode proc_datanode proc_secondarynamenode
start-yarn.sh
访问http://localhost:8088
最新文章
- MFC-简单的函数使用
- 【C语言学习】《C Primer Plus》第12章 存储类、链接和内存管理
- 终极优化_详解Win7旗舰版系统中可以关闭的服务
- Runner站立会议之个人会议(冲刺二)
- Myeclipse中无法删除部署在tomcat上的工程
- 51nod1086 背包问题 V2
- DailyWallpaper v1.02 released
- The 50 Most Essential Pieces of Classical Music
- 【数学】HDU 5753 Permutation Bo
- 排列与组合的C语言实现
- linux下一个php未找到php型材php.ini解决方案
- Java中Comparable和Comparator你知多少?
- solr6.5.0版本(Windows安装图解)
- php中的md5()的安全问题
- 使用binlog,实现MySQL数据恢复
- 修改Mysql5.7的root密码
- Linux中的15个基本&#39;ls&#39;命令示例
- centos7.5 安装mysql8.0.13
- SVM理解
- 【Vue】VS Code+Vue入门 Helloworld
热门文章
- Docker使用札记 - 常用命令
- Java 时间类
- android TextView 例子代码(文字中划线、文字下划线)
- 29.如何不用 transition 和 animation 也能做网页动画
- 23.纯 CSS 创作一个菜单反色填充特效
- excel导入导出的两种方式:csv和XLS
- docker 2 容器数据卷
- js检查字符串的包含关系
- 机器学习进阶-案例实战-答题卡识别判 1.cv2.getPerspectiveTransform(获得投射变化后的H矩阵) 2.cv2.warpPerspective(H获得变化后的图像) 3.cv2.approxPolyDP(近似轮廓) 4.cv2.threshold(二值变化) 7.cv2.countNonezeros(非零像素点个数)6.cv2.bitwise_and(与判断)
- C# 调用 C++ 的 DLL 返回值为 bool 时,值混乱