Download as DOCX, PDF, TXT or read online from Scribd
Download as docx, pdf, or txt
You are on page 1/ 4
Big Data Practical
Computing No. 2 File Management Task in Hadoop: 1. Create a directory in HDFS at given path(s). Usage : Hadoop fs -mkdir <paths> Example : Hadoop fs -mkdir/user/saurzcode
Usage : hadoop fs - put Example : hadoop fs – put /home /saurzcode /samplefile.txt /user/saurzcode /dir3
Download: hadoop fs -get: Copies/Downloads files to the local file system Usage: hadoop fs -get <hdfs_src> <localdst> Example: hadoop fs -get /user/saurzcode/dir3/Samplefile.txt /home/
4. See contents of a file
Same as unix cat command: Usage: hadoop fs -cat <path[filename]> Example: hadoop fs -cat /user/saurzcode/dir1/abc.txt
5. Copy a file from source to destination
This command allows multiple sources as well in which case the destination must be a directory. Usage: hadoop fs -cp <source> <dest> Example: hadoop fs -cp /user/saurzcode/dir1/abc.txt /user/saurzcode/ dir2 6. Copy a file from/To Local file system to HDFS Big Data Practical Computing No. 2 copyFromLoc al Usage: hadoop fs -copyFromLocal <localsrc> URI Example: hadoop fs -copyFromLocal /home/saurzcode/abc.txt /user/ saurzcode/abc.txt Similar to put command, except that the source is restricted to a local file reference. copyToLoc al Usage: hadoop fs -copyToLocal [-ignorecrc] [-crc] URI <localdst> Similar to get command, except that the destination is restricted to a local file reference.
7. Move file from source to destination.
Note:- Moving files across filesystem is not permitted. Usage : hadoop fs -mv <src> <dest> Example: hadoop fs -mv /user/saurzcode/dir1/abc.txt /user/saurzcode/ dir2
8. Remove a file or directory in HDFS.
Remove files specified as argument. Deletes directory only when it is empty Usage : hadoop fs -rm <arg> Example: hadoop fs -rm /user/saurzcode/dir1/abc.txt Recursive version of delete. Usage : hadoop fs -rmr <arg> Example: hadoop fs -rmr /user/saurzcode/
9. Display last few lines of a file.
Similar to tail command in
Unix. Usage : hadoop fs -tail <path[filename]> Example: hadoop fs -tail /user/saurzcode/dir1/abc.txt 10. Display the aggregate length of a file. Big Data Practical Computing No. 2 Big Data Practical Computing No. 2
