-
- Downloads
[SPARK-20281][SQL] Print the identical Range parameters of SparkContext APIs and SQL in explain
## What changes were proposed in this pull request? This pr modified code to print the identical `Range` parameters of SparkContext APIs and SQL in `explain` output. In the current master, they internally use `defaultParallelism` for `splits` by default though, they print different strings in explain output; ``` scala> spark.range(4).explain == Physical Plan == *Range (0, 4, step=1, splits=Some(8)) scala> sql("select * from range(4)").explain == Physical Plan == *Range (0, 4, step=1, splits=None) ``` ## How was this patch tested? Added tests in `SQLQuerySuite` and modified some results in the existing tests. Author: Takeshi Yamamuro <yamamuro@apache.org> Closes #17670 from maropu/SPARK-20281.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicPhysicalOperators.scala 2 additions, 1 deletion...g/apache/spark/sql/execution/basicPhysicalOperators.scala
- sql/core/src/test/resources/sql-tests/results/sql-compatibility-functions.sql.out 1 addition, 1 deletion...ces/sql-tests/results/sql-compatibility-functions.sql.out
- sql/core/src/test/resources/sql-tests/results/table-valued-functions.sql.out 1 addition, 1 deletion...esources/sql-tests/results/table-valued-functions.sql.out
Please register or sign in to comment