-
- Downloads
[SPARK-11646] WholeTextFileRDD should return Text rather than String
If it returns Text, we can reuse this in Spark SQL to provide a WholeTextFile data source and directly convert the Text into UTF8String without extra string decoding and encoding. Author: Reynold Xin <rxin@databricks.com> Closes #9622 from rxin/SPARK-11646.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 3 additions, 3 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/input/WholeTextFileInputFormat.scala 3 additions, 3 deletions...ala/org/apache/spark/input/WholeTextFileInputFormat.scala
- core/src/main/scala/org/apache/spark/input/WholeTextFileRecordReader.scala 6 additions, 6 deletions...la/org/apache/spark/input/WholeTextFileRecordReader.scala
- core/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala 1 addition, 32 deletionscore/src/main/scala/org/apache/spark/rdd/NewHadoopRDD.scala
- core/src/main/scala/org/apache/spark/rdd/WholeTextFileRDD.scala 56 additions, 0 deletions...rc/main/scala/org/apache/spark/rdd/WholeTextFileRDD.scala
Loading
Please register or sign in to comment