-
- Downloads
[SPARK-11946][SQL] Audit pivot API for 1.6.
Currently pivot's signature looks like ```scala scala.annotation.varargs def pivot(pivotColumn: Column, values: Column*): GroupedData scala.annotation.varargs def pivot(pivotColumn: String, values: Any*): GroupedData ``` I think we can remove the one that takes "Column" types, since callers should always be passing in literals. It'd also be more clear if the values are not varargs, but rather Seq or java.util.List. I also made similar changes for Python. Author: Reynold Xin <rxin@databricks.com> Closes #9929 from rxin/SPARK-11946.
Showing
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 0 additions, 1 deletion.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- python/pyspark/sql/group.py 8 additions, 4 deletionspython/pyspark/sql/group.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/literals.scala 1 addition, 0 deletions.../org/apache/spark/sql/catalyst/expressions/literals.scala
- sql/core/src/main/scala/org/apache/spark/sql/GroupedData.scala 88 additions, 66 deletions...ore/src/main/scala/org/apache/spark/sql/GroupedData.scala
- sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java 16 additions, 0 deletions...st/java/test/org/apache/spark/sql/JavaDataFrameSuite.java
- sql/core/src/test/scala/org/apache/spark/sql/DataFramePivotSuite.scala 11 additions, 10 deletions...test/scala/org/apache/spark/sql/DataFramePivotSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestData.scala 1 addition, 0 deletions...rc/test/scala/org/apache/spark/sql/test/SQLTestData.scala
Loading
Please register or sign in to comment