Skip to content

Commit c9033c1

Browse files
judasnjudasn
committed
🚧 hadoop
1 parent 16c09a8 commit c9033c1

File tree

1 file changed

+16
-2
lines changed

1 file changed

+16
-2
lines changed

‎markdown-file/Hadoop-Install-And-Settings.md

Lines changed: 16 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -432,13 +432,27 @@ tcp6 0 0 :::37481 :::* LISTEN
432432

433433
## 运行作业
434434

435+
- 在主节点上操作
435436
- 运行一个 Mapreduce 作业试试：
436-
- `hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.5.jar pi 5 10`
437+
- 计算 π：`hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.5.jar pi 5 10`
438+
- 运行一个文件相关作业：
439+
- 由于运行 hadoop 时指定的输入文件只能是 HDFS 文件系统中的文件，所以我们必须将要进行 wordcount 的文件从本地文件系统拷贝到 HDFS 文件系统中。
440+
- 查看目前根目录结构：`hadoop fs -ls /`
441+
- 创建目录：`hadoop fs -mkdir -p /tmp/zch/wordcount_input_dir`
442+
- 上传文件：`hadoop fs -put /opt/input.txt /tmp/zch/wordcount_input_dir`
443+
- 查看上传的目录下是否有文件：`hadoop fs -ls /tmp/zch/wordcount_input_dir`
444+
- 向 yarn 提交作业，计算单词个数：`hadoop jar $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.5.jar wordcount /tmp/zch/wordcount_input_dir /tmp/zch/wordcount_output_dir`
445+
- 查看计算结果输出的目录：`hadoop fs -ls /tmp/zch/wordcount_output_dir`
446+
- 查看计算结果输出内容：`hadoop fs -cat /tmp/zch/wordcount_output_dir/part-r-00000`
447+
- 查看正在运行的 Hadoop 任务：`yarn application -list`
448+
- 关闭 Hadoop 任务进程：`yarn application -kill 你的ApplicationId`
449+
437450

438451
-------------------------------------------------------------------
439452

440453
## 资料
441454

442455
- <https://www.linode.com/docs/databases/hadoop/how-to-install-and-set-up-hadoop-cluster/>
443456
- <http://www.cnblogs.com/Leo_wl/p/7426496.html>
444-
- <https://blog.csdn.net/bingduanlbd/article/details/51892750>
457+
- <https://blog.csdn.net/bingduanlbd/article/details/51892750>
458+
- <https://blog.csdn.net/whdxjbw/article/details/81050597>

0 commit comments

Comments
 (0)