-
- Downloads
[SPARK-11564][SQL][FOLLOW-UP] clean up java tuple encoder
We need to support custom classes like java beans and combine them into tuple, and it's very hard to do it with the TypeTag-based approach. We should keep only the compose-based way to create tuple encoder. This PR also move `Encoder` to `org.apache.spark.sql` Author: Wenchen Fan <wenchen@databricks.com> Closes #9567 from cloud-fan/java.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/Encoder.scala 7 additions, 58 deletions...atalyst/src/main/scala/org/apache/spark/sql/Encoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.scala 5 additions, 5 deletions...pache/spark/sql/catalyst/encoders/ExpressionEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/package.scala 2 additions, 1 deletion...cala/org/apache/spark/sql/catalyst/encoders/package.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala 1 addition, 0 deletions...che/spark/sql/catalyst/plans/logical/basicOperators.scala
- sql/core/src/main/scala/org/apache/spark/sql/Column.scala 1 addition, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/Column.scala
- sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala 0 additions, 2 deletionssql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
- sql/core/src/main/scala/org/apache/spark/sql/GroupedDataset.scala 1 addition, 1 deletion.../src/main/scala/org/apache/spark/sql/GroupedDataset.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 1 addition, 1 deletion...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TypedAggregateExpression.scala 2 additions, 1 deletion...rk/sql/execution/aggregate/TypedAggregateExpression.scala
- sql/core/src/main/scala/org/apache/spark/sql/expressions/Aggregator.scala 2 additions, 1 deletion...n/scala/org/apache/spark/sql/expressions/Aggregator.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 1 addition, 1 deletionsql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/test/java/test/org/apache/spark/sql/JavaDatasetSuite.java 41 additions, 37 deletions...test/java/test/org/apache/spark/sql/JavaDatasetSuite.java
- sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala 1 addition, 3 deletions...t/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala 0 additions, 1 deletionsql/core/src/test/scala/org/apache/spark/sql/QueryTest.scala
Loading
Please register or sign in to comment