-
- Downloads
[SPARK-14596][SQL] Remove not used SqlNewHadoopRDD and some more unused imports
## What changes were proposed in this pull request? Old `HadoopFsRelation` API includes `buildInternalScan()` which uses `SqlNewHadoopRDD` in `ParquetRelation`. Because now the old API is removed, `SqlNewHadoopRDD` is not used anymore. So, this PR removes `SqlNewHadoopRDD` and several unused imports. This was discussed in https://github.com/apache/spark/pull/12326. ## How was this patch tested? Several related existing unit tests and `sbt scalastyle`. Author: hyukjinkwon <gurwls223@gmail.com> Closes #12354 from HyukjinKwon/SPARK-14596.
Showing
- core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala 3 additions, 5 deletionscore/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala
- core/src/main/scala/org/apache/spark/rdd/InputFileNameHolder.scala 3 additions, 3 deletions...main/scala/org/apache/spark/rdd/InputFileNameHolder.scala
- project/MimaExcludes.scala 0 additions, 5 deletionsproject/MimaExcludes.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/InputFileName.scala 4 additions, 4 deletions...apache/spark/sql/catalyst/expressions/InputFileName.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala 5 additions, 6 deletions.../apache/spark/sql/execution/datasources/FileScanRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SqlNewHadoopRDD.scala 0 additions, 282 deletions...che/spark/sql/execution/datasources/SqlNewHadoopRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala 0 additions, 1 deletion...rc/main/scala/org/apache/spark/sql/internal/SQLConf.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala 1 addition, 4 deletions...k/sql/execution/datasources/FileSourceStrategySuite.scala
Loading
Please register or sign in to comment