-
- Downloads
[SPARK-11090] [SQL] Constructor for Product types from InternalRow
This is a first draft of the ability to construct expressions that will take a catalyst internal row and construct a Product (case class or tuple) that has fields with the correct names. Support include: - Nested classes - Maps - Efficiently handling of arrays of primitive types Not yet supported: - Case classes that require custom collection types (i.e. List instead of Seq). Author: Michael Armbrust <michael@databricks.com> Closes #9100 from marmbrus/productContructor.
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java 4 additions, 0 deletions...pache/spark/sql/catalyst/expressions/UnsafeArrayData.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 299 additions, 3 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/Encoder.scala 14 additions, 0 deletions...cala/org/apache/spark/sql/catalyst/encoders/Encoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoder.scala 23 additions, 3 deletions...g/apache/spark/sql/catalyst/encoders/ProductEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala 134 additions, 20 deletions...a/org/apache/spark/sql/catalyst/expressions/objects.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/ArrayBasedMapData.scala 4 additions, 0 deletions.../scala/org/apache/spark/sql/types/ArrayBasedMapData.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/ArrayData.scala 5 additions, 0 deletions...src/main/scala/org/apache/spark/sql/types/ArrayData.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/GenericArrayData.scala 3 additions, 1 deletion...n/scala/org/apache/spark/sql/types/GenericArrayData.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoderSuite.scala 237 additions, 132 deletions...che/spark/sql/catalyst/encoders/ProductEncoderSuite.scala
Loading
Please register or sign in to comment