Merge pull request sequenceiq#51 from wjur/submit_from_outside

Marton Sereg · Marton Sereg · commit bbdf3430e3ea · 2016-06-08T09:31:08.000+02:00
Describe submitting from the outside of the container
diff --git a/README.md b/README.md
@@ -33,7 +33,7 @@ docker run -d -h sandbox sequenceiq/spark:1.6.0 -d
 
 ## Versions
 ```
-Hadoop 2.6.0 and Apache Spark v1.6.0 on Centos 
+Hadoop 2.6.0 and Apache Spark v1.6.0 on Centos
 ```
 
 ## Testing
@@ -86,3 +86,16 @@ spark-submit \
 --executor-cores 1 \
 $SPARK_HOME/lib/spark-examples-1.6.0-hadoop2.6.0.jar
 ```
+
+### Submitting from the outside of the container
+To use Spark from outside of the container it is necessary to set the YARN_CONF_DIR environment variable to directory with a configuration appropriate for the docker. The repository contains such configuration in the yarn-remote-client directory.
+
+```
+export YARN_CONF_DIR="`pwd`/yarn-remote-client"
+```
+
+Docker's HDFS can be accessed only by root. When submitting Spark applications from outside of the cluster, and from a user different than root, it is necessary to configure the HADOOP_USER_NAME variable so that root user is used.
+
+```
+export HADOOP_USER_NAME=root
+```
