-
- Downloads
[SPARK-19882][SQL] Pivot with null as a distinct pivot value throws NPE
## What changes were proposed in this pull request? Allows null values of the pivot column to be included in the pivot values list without throwing NPE Note this PR was made as an alternative to #17224 but preserves the two phase aggregate operation that is needed for good performance. ## How was this patch tested? Additional unit test Author: Andrew Ray <ray.andrew@gmail.com> Closes #17226 from aray/pivot-null.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 1 addition, 1 deletion...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PivotFirst.scala 9 additions, 9 deletions...spark/sql/catalyst/expressions/aggregate/PivotFirst.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFramePivotSuite.scala 14 additions, 0 deletions...test/scala/org/apache/spark/sql/DataFramePivotSuite.scala
Loading
Please register or sign in to comment