-
- Downloads
[SPARK-12792] [SPARKR] Refactor RRDD to support R UDF.
## What changes were proposed in this pull request? Refactor RRDD by separating the common logic interacting with the R worker to a new class RRunner, which can be used to evaluate R UDFs. Now RRDD relies on RRuner for RDD computation and RRDD could be reomved if we want to remove RDD API in SparkR later. ## How was this patch tested? dev/lint-r SparkR unit tests Author: Sun Rui <rui.sun@intel.com> Closes #12024 from sun-rui/SPARK-12792_new.
Showing
- R/pkg/inst/tests/testthat/test_rdd.R 8 additions, 0 deletionsR/pkg/inst/tests/testthat/test_rdd.R
- core/src/main/scala/org/apache/spark/api/r/RRDD.scala 4 additions, 324 deletionscore/src/main/scala/org/apache/spark/api/r/RRDD.scala
- core/src/main/scala/org/apache/spark/api/r/RRunner.scala 368 additions, 0 deletionscore/src/main/scala/org/apache/spark/api/r/RRunner.scala
Loading
Please register or sign in to comment