-
- Downloads
[SPARK-11802][SQL] Kryo-based encoder for opaque types in Datasets
I also found a bug with self-joins returning incorrect results in the Dataset API. Two test cases attached and filed SPARK-11803. Author: Reynold Xin <rxin@databricks.com> Closes #9789 from rxin/SPARK-11802.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/Encoder.scala 29 additions, 2 deletions...atalyst/src/main/scala/org/apache/spark/sql/Encoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala 3 additions, 1 deletion...pache/spark/sql/catalyst/encoders/ExpressionEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoder.scala 1 addition, 1 deletion...g/apache/spark/sql/catalyst/encoders/ProductEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala 66 additions, 3 deletions...a/org/apache/spark/sql/catalyst/expressions/objects.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/FlatEncoderSuite.scala 18 additions, 0 deletions...apache/spark/sql/catalyst/encoders/FlatEncoderSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala 6 additions, 0 deletionssql/core/src/main/scala/org/apache/spark/sql/Dataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/GroupedDataset.scala 0 additions, 1 deletion.../src/main/scala/org/apache/spark/sql/GroupedDataset.scala
- sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala 55 additions, 15 deletions...re/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
Loading
Please register or sign in to comment