-
- Downloads
[SPARK-10613] [SPARK-10624] [SQL] Reduce LocalNode tests dependency on SQLContext
Instead of relying on `DataFrames` to verify our answers, we can just use simple arrays. This significantly simplifies the test logic for `LocalNode`s and reduces a lot of code duplicated from `SparkPlanTest`. This also fixes an additional issue [SPARK-10624](https://issues.apache.org/jira/browse/SPARK-10624) where the output of `TakeOrderedAndProjectNode` is not actually ordered. Author: Andrew Or <andrew@databricks.com> Closes #8764 from andrewor14/sql-local-tests-cleanup.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/local/LocalNode.scala 2 additions, 6 deletions...cala/org/apache/spark/sql/execution/local/LocalNode.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/local/SampleNode.scala 6 additions, 10 deletions...ala/org/apache/spark/sql/execution/local/SampleNode.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/local/TakeOrderedAndProjectNode.scala 1 addition, 1 deletion...spark/sql/execution/local/TakeOrderedAndProjectNode.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/SparkPlanTest.scala 1 addition, 1 deletion.../scala/org/apache/spark/sql/execution/SparkPlanTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/DummyNode.scala 68 additions, 0 deletions...cala/org/apache/spark/sql/execution/local/DummyNode.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/ExpandNodeSuite.scala 26 additions, 28 deletions...rg/apache/spark/sql/execution/local/ExpandNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/FilterNodeSuite.scala 19 additions, 15 deletions...rg/apache/spark/sql/execution/local/FilterNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/HashJoinNodeSuite.scala 61 additions, 80 deletions.../apache/spark/sql/execution/local/HashJoinNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/IntersectNodeSuite.scala 13 additions, 11 deletions...apache/spark/sql/execution/local/IntersectNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/LimitNodeSuite.scala 15 additions, 13 deletions...org/apache/spark/sql/execution/local/LimitNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/LocalNodeSuite.scala 15 additions, 58 deletions...org/apache/spark/sql/execution/local/LocalNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/LocalNodeTest.scala 36 additions, 129 deletions.../org/apache/spark/sql/execution/local/LocalNodeTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/NestedLoopJoinNodeSuite.scala 111 additions, 205 deletions...e/spark/sql/execution/local/NestedLoopJoinNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/ProjectNodeSuite.scala 22 additions, 17 deletions...g/apache/spark/sql/execution/local/ProjectNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/SampleNodeSuite.scala 23 additions, 12 deletions...rg/apache/spark/sql/execution/local/SampleNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/TakeOrderedAndProjectNodeSuite.scala 23 additions, 27 deletions.../sql/execution/local/TakeOrderedAndProjectNodeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/local/UnionNodeSuite.scala 26 additions, 23 deletions...org/apache/spark/sql/execution/local/UnionNodeSuite.scala
Loading
Please register or sign in to comment