-
- Downloads
[SQL] [SPARK-6620] Speed up toDF() and rdd() functions by constructing...
[SQL] [SPARK-6620] Speed up toDF() and rdd() functions by constructing converters in ScalaReflection cc marmbrus Author: Volodymyr Lyubinets <vlyubin@gmail.com> Closes #5279 from vlyubin/speedup and squashes the following commits: e75a387 [Volodymyr Lyubinets] Changes to ScalaUDF 11a20ec [Volodymyr Lyubinets] Avoid creating a tuple c327bc9 [Volodymyr Lyubinets] Moved the only remaining function from DataTypeConversions to DateUtils dec6802 [Volodymyr Lyubinets] Addresed review feedback 74301fa [Volodymyr Lyubinets] Addressed review comments afa3aa5 [Volodymyr Lyubinets] Minor refactoring, added license, removed debug output 881dc60 [Volodymyr Lyubinets] Moved to a separate module; addressed review comments; one extra place of usage; changed behaviour for Java 8cad6e2 [Volodymyr Lyubinets] Addressed review commments 41b2aa9 [Volodymyr Lyubinets] Creating converters for ScalaReflection stuff, and more
Showing
- mllib/src/test/scala/org/apache/spark/ml/feature/TokenizerSuite.scala 7 additions, 10 deletions...st/scala/org/apache/spark/ml/feature/TokenizerSuite.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala 295 additions, 0 deletions...rg/apache/spark/sql/catalyst/CatalystTypeConverters.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 0 additions, 55 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala 537 additions, 282 deletions.../org/apache/spark/sql/catalyst/expressions/ScalaUdf.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LocalRelation.scala 4 additions, 3 deletions...ache/spark/sql/catalyst/plans/logical/LocalRelation.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataTypeConversions.scala 0 additions, 77 deletions...cala/org/apache/spark/sql/types/DataTypeConversions.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/DateUtils.scala 29 additions, 0 deletions...src/main/scala/org/apache/spark/sql/types/DateUtils.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala 2 additions, 2 deletions.../org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 7 additions, 4 deletionssql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 5 additions, 4 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala 7 additions, 7 deletions...in/scala/org/apache/spark/sql/execution/ExistingRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/LocalTableScan.scala 11 additions, 5 deletions...scala/org/apache/spark/sql/execution/LocalTableScan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlan.scala 8 additions, 3 deletions...main/scala/org/apache/spark/sql/execution/SparkPlan.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala 5 additions, 4 deletions...scala/org/apache/spark/sql/execution/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala 2 additions, 2 deletions...re/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala
- sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java 9 additions, 1 deletion...st/java/test/org/apache/spark/sql/JavaDataFrameSuite.java
- sql/core/src/test/scala/org/apache/spark/sql/json/JsonSuite.scala 1 addition, 2 deletions.../src/test/scala/org/apache/spark/sql/json/JsonSuite.scala
Loading
Please register or sign in to comment