-
- Downloads
[SPARK-8641][SQL] Native Spark Window functions
This PR removes Hive windows functions from Spark and replaces them with (native) Spark ones. The PR is on par with Hive in terms of features. This has the following advantages: * Better memory management. * The ability to use spark UDAFs in Window functions. cc rxin / yhuai Author: Herman van Hovell <hvanhovell@questtec.nl> Closes #9819 from hvanhovell/SPARK-8641-2.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 69 additions, 12 deletions...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala 29 additions, 10 deletions...rg/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala 11 additions, 1 deletion...apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala 2 additions, 5 deletions...spark/sql/catalyst/expressions/aggregate/interfaces.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala 264 additions, 54 deletions...he/spark/sql/catalyst/expressions/windowExpressions.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisErrorSuite.scala 26 additions, 5 deletions...ache/spark/sql/catalyst/analysis/AnalysisErrorSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/Window.scala 370 additions, 279 deletions...rc/main/scala/org/apache/spark/sql/execution/Window.scala
- sql/core/src/main/scala/org/apache/spark/sql/expressions/WindowSpec.scala 2 additions, 52 deletions...n/scala/org/apache/spark/sql/expressions/WindowSpec.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 8 additions, 8 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameWindowSuite.scala 118 additions, 82 deletions...est/scala/org/apache/spark/sql/DataFrameWindowSuite.scala
- sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveWindowFunctionQuerySuite.scala 8 additions, 2 deletions...ark/sql/hive/execution/HiveWindowFunctionQuerySuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 0 additions, 1 deletion...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala 11 additions, 11 deletions...ive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala 0 additions, 224 deletions...e/src/main/scala/org/apache/spark/sql/hive/hiveUDFs.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/WindowQuerySuite.scala 230 additions, 0 deletions...rg/apache/spark/sql/hive/execution/WindowQuerySuite.scala
Loading
Please register or sign in to comment