目的:

学会HDFS CLI 常用操作

环境:

Hadoop 2.6.4 伪分布式版

环境搭建参考本博客前篇文章:

伪分布式 hadoop 2.6.4

帮助:

hadoop@ssmaster:~$ hadoop fs
Usage: hadoop fs [generic options]
[-appendToFile <localsrc> ... <dst>]
[-cat [-ignoreCrc] <src> ...]
[-checksum <src> ...]
[-chgrp [-R] GROUP PATH...]
[-chmod [-R] <MODE[,MODE]... | OCTALMODE> PATH...]
[-chown [-R] [OWNER][:[GROUP]] PATH...]
[-copyFromLocal [-f] [-p] [-l] <localsrc> ... <dst>]
[-copyToLocal [-p] [-ignoreCrc] [-crc] <src> ... <localdst>]
[-count [-q] [-h] <path> ...]
[-cp [-f] [-p | -p[topax]] <src> ... <dst>]
[-createSnapshot <snapshotDir> [<snapshotName>]]
[-deleteSnapshot <snapshotDir> <snapshotName>]
[-df [-h] [<path> ...]]
.........
.........

任务:

1  创建目录

hadoop@ssmaster:~$ hadoop fs -mkdir data
hadoop@ssmaster:~$ hadoop fs -ls /
Found items
drwxr-xr-x - hadoop supergroup -- : /data

2  Linux 本地准备文件,内容任意英文

hadoop@ssmaster:~$ vi paper.txt
hadoop@ssmaster:~$ ls
Desktop Documents Downloads examples.desktop hadoop-2.6..tar.gz Music paper.txt Pictures Public Templates Videos
hadoop@ssmaster:~$ more paper.txt

There are moments in life when you miss someone so much that you just want to pick them from your dreams and hug them for real! Dream
what you want to dream;go where you want to go;be what you want to be,because you have only one life and one chance to do all the th
ings you want to do

.....

3  上传文件 Linux 本地到 HDFS

hadoop@ssmaster:~$ hadoop fs -put paper.txt /data
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it. hadoop@ssmaster:~$ hadoop fs -ls /data
Found items
-rw-r--r-- hadoop supergroup -- : /data/paper.txt

4  查看HDFS 文件内容

hadoop@ssmaster:~$ hadoop fs -cat /data/paper.txt
There are moments in life when you miss someone so much that you just want to pick them from your dreams and hug them for real! Dream what you want to dream;go where you want to go;be what you want to be,because you have only one life and one chance to do all the things you want to do.

5 下载到linux本地

hadoop@ssmaster:~$ rm paper.txt
hadoop@ssmaster:~$ ls
Desktop Documents Downloads examples.desktop hadoop-2.6..tar.gz Music Pictures Public Templates Videos
hadoop@ssmaster:~$ hadoop fs -get /data/paper.txt
hadoop@ssmaster:~$ ls
Desktop Documents Downloads examples.desktop hadoop-2.6..tar.gz Music paper.txt Pictures Public Templates Videos

6  删除HDFS 文件

hadoop@ssmaster:~$ hadoop fs -rm /data/paper.txt
// :: INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = minutes, Emptier interval = minutes.
Deleted /data/paper.tx

7 删除目录

hadoop@ssmaster:~$ hadoop fs -ls /
Found items
drwxr-xr-x - hadoop supergroup -- : /data
drwxr-xr-x - hadoop supergroup -- : /input
drwxr-xr-x - hadoop supergroup -- : /output
drwx------ - hadoop supergroup -- : /tmp hadoop@ssmaster:~$ hadoop fs -rm -r /input
// :: INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = minutes, Emptier interval = minutes.
Deleted /input
hadoop@ssmaster:~$ hadoop fs -ls /
Found items
drwxr-xr-x - hadoop supergroup -- : /data
drwxr-xr-x - hadoop supergroup -- : /output
drwx------ - hadoop supergroup -- : /tmp

最新文章

  1. HTML DOM Element
  2. 解决Windows 8系统假死的方法
  3. msbuild ConfuserEx.Build 加密
  4. awesome-very-deep-learning
  5. apache启用gzip压缩方法--转载自http://www.cnblogs.com/linzhenjie/archive/2013/03/05/2943635.html
  6. js获取节点
  7. mysql出现的错误
  8. thinkPHP模板引擎案例
  9. hdu3570, 超级简单的斜率优化dp
  10. 第一个ExtJS练习(添加用户面板)
  11. python 最基本的的单例模型的实现及应用
  12. rocketmq 4.4部署安装
  13. 在IIS7里配置 ISAPI,运行dll程序,总提示下载dll
  14. [20180403]访问dba_autotask_task无输出问题.txt
  15. [Spring Unit Testing] Spring Unit Testing with a Java Context
  16. javascript学习笔记(七):事件详解
  17. thinkphp结合layui上传视频
  18. HTML项目总结
  19. 如何去掉HTML代码来获取纯文本?
  20. UESTC 1246 拆x3

热门文章

  1. PostgreSQL update set from 两表联合更新,注意与其它数据库更新语法有差别
  2. 1.1选择select
  3. URL跳转绕过姿势
  4. ALV字段设置更改后,展示不同步的问题
  5. JS 注释
  6. Angular回顾(1)
  7. 19-Docker 镜像小结
  8. Octave中的矩阵常用操作2
  9. Linux下的 mariadb 使用 root 用户启动方式
  10. SPA项目开发之首页导航左侧菜单栏