Commit f05bae4

authored and

committed

[SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files

* ```jsonFile``` should support multiple input files, such as: ```R jsonFile(sqlContext, c(“path1”, “path2”)) # character vector as arguments jsonFile(sqlContext, “path1,path2”) ``` * Meanwhile, ```jsonFile``` has been deprecated by Spark SQL and will be removed at Spark 2.0. So we mark ```jsonFile``` deprecated and use ```read.json``` at SparkR side. * Replace all ```jsonFile``` with ```read.json``` at test_sparkSQL.R, but still keep jsonFile test case. * If this PR is accepted, we should also make almost the same change for ```parquetFile```. cc felixcheung sun-rui shivaram Author: Yanbo Liang <ybliang8@gmail.com> Closes apache#10145 from yanboliang/spark-12146. (cherry picked from commit 0fb9825) Signed-off-by: Shivaram Venkataraman <shivaram@cs.berkeley.edu>

1 parent 2e45231 commit f05bae4Copy full SHA for f05bae4

5 files changed

+138

-116

lines changed

R/pkg
- NAMESPACE
- R
  - DataFrame.R
  - SQLContext.R
- inst/tests/testthat
  - test_sparkSQL.R
examples/src/main/r
- dataframe.R

5 files changed

+138

-116

lines changed

`‎R/pkg/NAMESPACE`

-Original file line number
+Diff line change
        "createExternalTable",
        "dropTempTable",
        "jsonFile",
 +       "read.json",
        "loadDF",
        "parquetFile",
        "read.df",

Comments

(0)