-
- Downloads
[SPARK-21041][SQL] SparkSession.range should be consistent with SparkContext.range
## What changes were proposed in this pull request? This PR fixes the inconsistency in `SparkSession.range`. **BEFORE** ```scala scala> spark.range(java.lang.Long.MAX_VALUE - 3, java.lang.Long.MIN_VALUE + 2, 1).collect res2: Array[Long] = Array(9223372036854775804, 9223372036854775805, 9223372036854775806) ``` **AFTER** ```scala scala> spark.range(java.lang.Long.MAX_VALUE - 3, java.lang.Long.MIN_VALUE + 2, 1).collect res2: Array[Long] = Array() ``` ## How was this patch tested? Pass the Jenkins with newly added test cases. Author: Dongjoon Hyun <dongjoon@apache.org> Closes #18257 from dongjoon-hyun/SPARK-21041.
Showing
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicPhysicalOperators.scala 7 additions, 3 deletions...g/apache/spark/sql/execution/basicPhysicalOperators.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameRangeSuite.scala 11 additions, 0 deletions...test/scala/org/apache/spark/sql/DataFrameRangeSuite.scala
Please register or sign in to comment