-
- Downloads
[SPARK-6145][SQL] fix ORDER BY on nested fields
This PR is based on work by cloud-fan in #4904, but with two differences: - We isolate the logic for Sort's special handling into `ResolveSortReferences` - We avoid creating UnresolvedGetField expressions during resolution. Instead we either resolve GetField or we return None. This avoids us going down the wrong path early on. Author: Michael Armbrust <michael@databricks.com> Closes #5189 from marmbrus/nestedOrderBy and squashes the following commits: b8cae45 [Michael Armbrust] fix another test 0f36a11 [Michael Armbrust] WIP 91820cd [Michael Armbrust] Fix bug.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 55 additions, 21 deletions...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala 9 additions, 3 deletions...rg/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/AttributeSet.scala 1 addition, 1 deletion.../apache/spark/sql/catalyst/expressions/AttributeSet.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala 62 additions, 14 deletions...apache/spark/sql/catalyst/plans/logical/LogicalPlan.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala 35 additions, 4 deletions...rg/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 5 additions, 9 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 14 additions, 5 deletions...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/DataSourceTest.scala 4 additions, 0 deletions...t/scala/org/apache/spark/sql/sources/DataSourceTest.scala
Loading
Please register or sign in to comment