-
- Downloads
[SPARK-11216] [SQL] add encoder/decoder for external row
Implement encode/decode for external row based on `ClassEncoder`. TODO: * code cleanup * ~~fix corner cases~~ * refactor the encoder interface * improve test for product codegen, to cover more corner cases. Author: Wenchen Fan <wenchen@databricks.com> Closes #9184 from cloud-fan/encoder.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 3 additions, 3 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ClassEncoder.scala 75 additions, 0 deletions...org/apache/spark/sql/catalyst/encoders/ClassEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/Encoder.scala 1 addition, 1 deletion...cala/org/apache/spark/sql/catalyst/encoders/Encoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoder.scala 2 additions, 44 deletions...g/apache/spark/sql/catalyst/encoders/ProductEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala 234 additions, 0 deletions...a/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala 42 additions, 4 deletions...a/org/apache/spark/sql/catalyst/expressions/objects.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/ArrayBasedMapData.scala 4 additions, 0 deletions.../scala/org/apache/spark/sql/types/ArrayBasedMapData.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/RandomDataGenerator.scala 2 additions, 2 deletions...test/scala/org/apache/spark/sql/RandomDataGenerator.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/RowEncoderSuite.scala 96 additions, 0 deletions.../apache/spark/sql/catalyst/encoders/RowEncoderSuite.scala
Loading
Please register or sign in to comment