-
- Downloads
[SPARK-12146][SPARKR] SparkR jsonFile should support multiple input files
* ```jsonFile``` should support multiple input files, such as: ```R jsonFile(sqlContext, c(“path1”, “path2”)) # character vector as arguments jsonFile(sqlContext, “path1,path2”) ``` * Meanwhile, ```jsonFile``` has been deprecated by Spark SQL and will be removed at Spark 2.0. So we mark ```jsonFile``` deprecated and use ```read.json``` at SparkR side. * Replace all ```jsonFile``` with ```read.json``` at test_sparkSQL.R, but still keep jsonFile test case. * If this PR is accepted, we should also make almost the same change for ```parquetFile```. cc felixcheung sun-rui shivaram Author: Yanbo Liang <ybliang8@gmail.com> Closes #10145 from yanboliang/spark-12146.
Showing
- R/pkg/NAMESPACE 1 addition, 0 deletionsR/pkg/NAMESPACE
- R/pkg/R/DataFrame.R 51 additions, 51 deletionsR/pkg/R/DataFrame.R
- R/pkg/R/SQLContext.R 19 additions, 10 deletionsR/pkg/R/SQLContext.R
- R/pkg/inst/tests/testthat/test_sparkSQL.R 66 additions, 54 deletionsR/pkg/inst/tests/testthat/test_sparkSQL.R
- examples/src/main/r/dataframe.R 1 addition, 1 deletionexamples/src/main/r/dataframe.R
Loading
Please register or sign in to comment