ubuntu安装hadoop2.6
2024-09-12 16:32:27
一:单机版
1.sudo gedit ~/.bashrc 加入JDK路径
#HADOOP VARIABLES START
export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-amd64
export HADOOP_INSTALL=/home/sendi/hadoop-2.6.0
export PATH=$PATH:$HADOOP_INSTALL/bin
export PATH=$PATH:$HADOOP_INSTALL/sbin
export HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_HOME=$HADOOP_INSTALL
export HADOOP_HDFS_HOME=$HADOOP_INSTALL
export YARN_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib"
#HADOOP VARIABLES END
ubantu下jdk路径可用如下命令取得:
update-alternatives --config java
2.执行下面命令使改动生效:
source ~/.bashrc
3.修改hadoop-env.sh的配置:
sudo gedit /usr/local/hadoop/etc/hadoop/hadoop-env.sh
找到JAVA_HOME改为:
/usr/lib/jvm/java-1.7.0-openjdk-amd64
再在下面加上一行代码:
export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native"
二:伪分布式:
1.sudo gedit /usr/local/hadoop/etc/hadoop/core-site.xml
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/home/sendi/hadoop-2.6.0/tmp</value>
<description>Abase for other temporary directories.</description>
</property>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
2.sudo gedit /usr/local/hadoop/etc/hadoop/mapred-site.xm
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
</configuration>
3.sudo gedit /usr/local/hadoop/etc/hadoop/yarn-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>
4.sudo gedit /usr/local/hadoop/etc/hadoop/hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value></value>
</property>
<property>
<name>dfs.namenode.name.dir</name>
<value>/home/sendi/hadoop-2.6./dfs/name</value>
</property>
<property>
<name>dfs.datanode.data.dir</name>
<value>/home/sendi/hadoop-2.6./dfs/data</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
</configuration>
5.sudo gedit /usr/local/hadoop/etc/hadoop/masters 添加:localhost
6.sudo gedit /usr/local/hadoop/etc/hadoop/slaves
添加:localhost
7.初始化文件系统HDFS
bin/hdfs namenode -format
8.启动,启动之后用下面链接查看结果
sbin/start-dfs.sh
sbin/start-yarn.sh
-------------------------------------------------------------------------------------------------------------------------------------------
sendi@sendijia:~/hadoop-2.6.0$ sbin/start-dfs.sh
Starting namenodes on [localhost]
localhost: starting namenode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-namenode-sendijia.out
localhost: starting datanode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-datanode-sendijia.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /home/sendi/hadoop-2.6.0/logs/hadoop-sendi-secondarynamenode-sendijia.out
sendi@sendijia:~/hadoop-2.6.0$ sbin/start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /home/sendi/hadoop-2.6.0/logs/yarn-sendi-resourcemanager-sendijia.out
localhost: starting nodemanager, logging to /home/sendi/hadoop-2.6.0/logs/yarn-sendi-nodemanager-sendijia.out
最新文章
- SSH面试题(struts2+Spring+hibernate)
- 解决webstorm卡顿问题
- linux时间时区设置
- css3 -- 过渡与动画
- CSS实现垂直居中
- [Elixir009]像GenServer一样用behaviour来规范接口
- Js中 关于top、clientTop、scrollTop、offsetTop的用法
- 关于oracle出现ORA-06143:连接未打开 解决方案
- 【php】中【event】之实现方式
- HTTP的头部
- Citrix XenApp6.5 另类发布文档
- POJ训练计划2418_Hardwood Species(Trie树)
- 腾讯云 Ubuntu16.04 搭建Git 服务
- Jquery获取元素高度
- visual studio 2017 报错 无法下载安装文件。请检查Internet连接,然后重试
- DataTables 表格固定栏使用方法
- CF587F Duff is Mad
- Matlab 使用的一些常用技巧
- 【转】Gacutil.exe(全局程序集缓存工具)
- BZOJ1150:[CTSC2007]数据备份
热门文章
- Linux 软中断
- Debian--changelog
- ADO.NET笔记——使用连接池
- 批处理cmd背景颜色
- 基础学习总结(六)--getContentRolver()的应用、内容监听者ContentObserver
- jQuery 遍历用法
- [Android教程]TextView使用SpannableString设置复合文本
- [大牛翻译系列]Hadoop(2)MapReduce 连接:复制连接(Replication join)
- Fedora9下解决无ifconfig指令
- opencv学习笔记(04)——ROI