-
- Downloads
[SPARK-11750][SQL] revert SPARK-11727 and code clean up
After some experiment, I found it's not convenient to have separate encoder builders: `FlatEncoder` and `ProductEncoder`. For example, when create encoders for `ScalaUDF`, we have no idea if the type `T` is flat or not. So I revert the splitting change in https://github.com/apache/spark/pull/9693, while still keeping the bug fixes and tests. Author: Wenchen Fan <wenchen@databricks.com> Closes #9726 from cloud-fan/follow.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/Encoder.scala 8 additions, 8 deletions...atalyst/src/main/scala/org/apache/spark/sql/Encoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 114 additions, 240 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala 10 additions, 9 deletions...pache/spark/sql/catalyst/encoders/ExpressionEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/FlatEncoder.scala 0 additions, 50 deletions.../org/apache/spark/sql/catalyst/encoders/FlatEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoder.scala 0 additions, 452 deletions...g/apache/spark/sql/catalyst/encoders/ProductEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala 2 additions, 10 deletions...a/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects.scala 2 additions, 5 deletions...a/org/apache/spark/sql/catalyst/expressions/objects.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala 0 additions, 68 deletions.../org/apache/spark/sql/catalyst/ScalaReflectionSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoderSuite.scala 214 additions, 4 deletions.../spark/sql/catalyst/encoders/ExpressionEncoderSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/FlatEncoderSuite.scala 0 additions, 99 deletions...apache/spark/sql/catalyst/encoders/FlatEncoderSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ProductEncoderSuite.scala 0 additions, 156 deletions...che/spark/sql/catalyst/encoders/ProductEncoderSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/GroupedDataset.scala 2 additions, 2 deletions.../src/main/scala/org/apache/spark/sql/GroupedDataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLImplicits.scala 10 additions, 13 deletions...re/src/main/scala/org/apache/spark/sql/SQLImplicits.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 2 additions, 2 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
Loading
Please register or sign in to comment