You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Then go to the spark-hbase installation directory and issue
57
57
```
58
-
./bin/pyspark-hbase
58
+
./bin/pyspark-hbase
59
59
```
60
60
A successfull message is as follows:
61
61
62
62
You are using Spark SQL on HBase!!!
63
63
HBaseSQLContext available as hsqlContext.
64
64
65
65
To run a python script, the PYTHONPATH environment should be set to the "python" directory of the Spark-HBase installation. For example,
66
-
67
-
export PYTHONPATH=/root-of-Spark-HBase/python
66
+
```
67
+
export PYTHONPATH=/root-of-Spark-HBase/python
68
+
```
68
69
69
70
Note that the shell commands are not included in the Zip file of the Spark release. They are for developers' use only for this version of 1.0.0. Instead, users can use "$SPARK_HOME/bin/spark-shell --packages Huawei-Spark/Spark-SQL-on-HBase:1.0.0" for SQL shell or "$SPARK_HOME/bin/pyspark --packages Huawei-Spark/Spark-SQL-on-HBase:1.0.0" for Pythin shell.
70
71
@@ -74,11 +75,11 @@ Testing first requires [building Spark HBase](#building-spark). Once Spark HBase
74
75
75
76
Run all test suites from Maven:
76
77
```
77
-
mvn -Phbase,hadoop-2.4 test
78
+
mvn -Phbase,hadoop-2.4 test
78
79
```
79
80
Run a single test suite from Maven, for example:
80
81
```
81
-
mvn -Phbase,hadoop-2.4 test -DwildcardSuites=org.apache.spark.sql.hbase.BasicQueriesSuite
82
+
mvn -Phbase,hadoop-2.4 test -DwildcardSuites=org.apache.spark.sql.hbase.BasicQueriesSuite
82
83
```
83
84
## IDE Setup
84
85
@@ -94,7 +95,7 @@ To import the current Spark HBase project for IntelliJ:
94
95
6. When you run the scala test, sometimes you will get out of memory exception. You can increase your VM memory usage by the following setting, for example:
95
96
96
97
```
97
-
-XX:MaxPermSize=512m -Xmx3072m
98
+
-XX:MaxPermSize=512m -Xmx3072m
98
99
```
99
100
100
101
You can also make those setting to be the default by setting to the "Defaults -> ScalaTest".
0 commit comments