-
- Downloads
[SPARK-13929] Use Scala reflection for UDTs
## What changes were proposed in this pull request? Enable ScalaReflection and User Defined Types for plain Scala classes. This involves the move of `schemaFor` from `ScalaReflection` trait (which is Runtime and Compile time (macros) reflection) to the `ScalaReflection` object (runtime reflection only) as I believe this code wouldn't work at compile time anyway as it manipulates `Class`'s that are not compiled yet. ## How was this patch tested? Unit test Author: Joan <joan@goyeau.com> Closes #12149 from joan38/SPARK-13929-Scala-reflection.
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/types/SQLUserDefinedType.java 0 additions, 5 deletions...n/java/org/apache/spark/sql/types/SQLUserDefinedType.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 42 additions, 56 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala 36 additions, 1 deletion.../org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala 75 additions, 48 deletions...est/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala 2 additions, 2 deletions...ache/spark/sql/execution/datasources/json/JsonSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/AggregationQuerySuite.scala 1 addition, 1 deletion...ache/spark/sql/hive/execution/AggregationQuerySuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala 1 addition, 1 deletion...org/apache/spark/sql/sources/hadoopFsRelationSuites.scala
Loading
Please register or sign in to comment