-
- Downloads
[SPARK-8635] [SQL] improve performance of CatalystTypeConverters
In `CatalystTypeConverters.createToCatalystConverter`, we add special handling for primitive types. We can apply this strategy to more places to improve performance. Author: Wenchen Fan <cloud0fan@outlook.com> Closes #7018 from cloud-fan/converter and squashes the following commits: 8b16630 [Wenchen Fan] another fix 326c82c [Wenchen Fan] optimize type converter
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala 37 additions, 23 deletions...rg/apache/spark/sql/catalyst/CatalystTypeConverters.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala 1 addition, 2 deletions.../org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 3 additions, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/stat/FrequentItems.scala 1 addition, 1 deletion...a/org/apache/spark/sql/execution/stat/FrequentItems.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/stat/StatFunctions.scala 1 addition, 1 deletion...a/org/apache/spark/sql/execution/stat/StatFunctions.scala
- sql/core/src/main/scala/org/apache/spark/sql/sources/DataSourceStrategy.scala 1 addition, 1 deletion...ala/org/apache/spark/sql/sources/DataSourceStrategy.scala
- sql/core/src/main/scala/org/apache/spark/sql/sources/commands.scala 2 additions, 2 deletions...rc/main/scala/org/apache/spark/sql/sources/commands.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/TableScanSuite.scala 2 additions, 2 deletions...t/scala/org/apache/spark/sql/sources/TableScanSuite.scala
Loading
Please register or sign in to comment