Skip to content

Commit a40bd98

Browse files
committed
just adding support for Spark 1.5.1
1 parent b9d2ed5 commit a40bd98

File tree

2 files changed

+8
-8
lines changed

2 files changed

+8
-8
lines changed

Dockerfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@ FROM sequenceiq/hadoop-docker:2.6.0
22
MAINTAINER SequenceIQ
33

44
#support for Hadoop 2.6.0
5-
RUN curl -s http://d3kbcqa49mib13.cloudfront.net/spark-1.4.0-bin-hadoop2.6.tgz | tar -xz -C /usr/local/
5+
RUN curl -s http://d3kbcqa49mib13.cloudfront.net/spark-1.5.1-bin-hadoop2.6.tgz | tar -xz -C /usr/local/
66
RUN cd /usr/local && ln -s spark-1.4.0-bin-hadoop2.6 spark
77
ENV SPARK_HOME /usr/local/spark
88
RUN mkdir $SPARK_HOME/yarn-remote-client

README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,12 @@ The base Hadoop Docker image is also available as an official [Docker image](htt
1010

1111
##Pull the image from Docker Repository
1212
```
13-
docker pull sequenceiq/spark:1.4.0
13+
docker pull sequenceiq/spark:1.5.1
1414
```
1515

1616
## Building the image
1717
```
18-
docker build --rm -t sequenceiq/spark:1.4.0 .
18+
docker build --rm -t sequenceiq/spark:1.5.1 .
1919
```
2020

2121
## Running the image
@@ -24,16 +24,16 @@ docker build --rm -t sequenceiq/spark:1.4.0 .
2424
* in your /etc/hosts file add $(boot2docker ip) as host 'sandbox' to make it easier to access your sandbox UI
2525
* open yarn UI ports when running container
2626
```
27-
docker run -it -p 8088:8088 -p 8042:8042 -h sandbox sequenceiq/spark:1.4.0 bash
27+
docker run -it -p 8088:8088 -p 8042:8042 -h sandbox sequenceiq/spark:1.5.1 bash
2828
```
2929
or
3030
```
31-
docker run -d -h sandbox sequenceiq/spark:1.4.0 -d
31+
docker run -d -h sandbox sequenceiq/spark:1.5.1 -d
3232
```
3333

3434
## Versions
3535
```
36-
Hadoop 2.6.0 and Apache Spark v1.4.0 on Centos
36+
Hadoop 2.6.0 and Apache Spark v1.5.1 on Centos
3737
```
3838

3939
## Testing
@@ -71,7 +71,7 @@ spark-submit \
7171
--driver-memory 1g \
7272
--executor-memory 1g \
7373
--executor-cores 1 \
74-
$SPARK_HOME/lib/spark-examples-1.4.0-hadoop2.6.0.jar
74+
$SPARK_HOME/lib/spark-examples-1.5.1-hadoop2.6.0.jar
7575
```
7676

7777
Estimating Pi (yarn-client mode):
@@ -84,5 +84,5 @@ spark-submit \
8484
--driver-memory 1g \
8585
--executor-memory 1g \
8686
--executor-cores 1 \
87-
$SPARK_HOME/lib/spark-examples-1.4.0-hadoop2.6.0.jar
87+
$SPARK_HOME/lib/spark-examples-1.5.1-hadoop2.6.0.jar
8888
```

0 commit comments

Comments
 (0)