Scribd
Upload
96 views1 page

To Install Fuse-Dfs On Ubuntu Systems

This document discusses how to install and configure FUSE (Filesystem in Userspace) to mount an HDFS cluster as a normal filesystem on Linux. It provides instructions for installing hadoop-hdfs-fuse on Ubuntu, mounting an HDFS cluster at a specified point, and configuring the mount to persist across reboots by adding an entry to /etc/fstab. Notes are included on configuration directory location and potential issues with Oracle JDK on SLES 11.

Uploaded by

excitekarthik
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
96 views1 page

To Install Fuse-Dfs On Ubuntu Systems

This document discusses how to install and configure FUSE (Filesystem in Userspace) to mount an HDFS cluster as a normal filesystem on Linux. It provides instructions for installing hadoop-hdfs-fuse on Ubuntu, mounting an HDFS cluster at a specified point, and configuring the mount to persist across reboots by adding an entry to /etc/fstab. Notes are included on configuration directory location and potential issues with Oracle JDK on SLES 11.

Uploaded by

excitekarthik
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 1

FUSE (Filesystem in Userspace) enables you to write a normal user application as a bridge for a

traditional filesystem interface.

The hadoop-hdfs-fuse package enables you to use your HDFS cluster as if it were a
traditional filesystem on Linux. It is assumed that you have a working HDFS cluster and know
the hostname and port that your NameNode exposes.

To install fuse-dfs on Ubuntu systems:

sudo apt-get install hadoop-hdfs-fuse

To set up and test your mount point:

mkdir -p <mount_point>
hadoop-fuse-dfs dfs://<name_node_hostname>:<namenode_port> <mount_point>

You can now run operations as if they are on your mount point. Press Ctrl+C to end the fuse-
dfs program, and umount the partition if it is still mounted.

  Note:

 To find its configuration directory, hadoop-fuse-dfs uses the HADOOP_CONF_DIR


configured at the time the mount command is invoked.
 If you are using SLES 11 with the Oracle JDK 6u26 package, hadoop-fuse-dfs may
exit immediately because ld.so can't find libjvm.so. To work around this issue, add
/usr/java/latest/jre/lib/amd64/server to the LD_LIBRARY_PATH.

To clean up your test:

$ umount <mount_point>

You can now add a permanent HDFS mount which persists through reboots. To add a system
mount:

1. Open /etc/fstab and add lines to the bottom similar to these:

hadoop-fuse-dfs#dfs://<name_node_hostname>:<namenode_port> <mount_point>
fuse allow_other,usetrash,rw 2 0

For example:

hadoop-fuse-dfs#dfs://localhost:8020 /mnt/hdfs fuse


allow_other,usetrash,rw 2 0

2. Test to make sure everything is working properly:

$ mount <mount_point>

Your system is now configured to allow you to use the ls command and use that mount point as
if it were a normal system disk.

You might also like