-
- Downloads
[SPARK-7886] Add built-in expressions to FunctionRegistry.
This patch switches to using FunctionRegistry for built-in expressions. It is based on #6463, but with some work to simplify it along with unit tests. TODOs for future pull requests: - Use static registration so we don't need to register all functions every time we start a new SQLContext - Switch to using this in HiveContext Author: Reynold Xin <rxin@databricks.com> Author: Santiago M. Mola <santi@mola.io> Closes #6710 from rxin/udf-registry and squashes the following commits: 6930822 [Reynold Xin] Fixed Python test. b802c9a [Reynold Xin] Made UDF case insensitive. e60d815 [Reynold Xin] Made UDF case insensitive. 852f9c0 [Reynold Xin] Fixed style violation. e76a3c1 [Reynold Xin] Fixed parser. 52ddaba [Reynold Xin] Fixed compilation. ee7854f [Reynold Xin] Improved error reporting. ff906f2 [Reynold Xin] More robust constructor calling. 77b46f1 [Reynold Xin] Simplified the code. 2a2a149 [Reynold Xin] Merge pull request #6463 from smola/SPARK-7886 8616924 [Santiago M. Mola] [SPARK-7886] Add built-in expressions to FunctionRegistry.
Showing
- python/pyspark/sql/dataframe.py 1 addition, 1 deletionpython/pyspark/sql/dataframe.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala 32 additions, 43 deletions.../main/scala/org/apache/spark/sql/catalyst/SqlParser.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 3 additions, 1 deletion...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala 96 additions, 31 deletions...apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala 9 additions, 0 deletions...rg/apache/spark/sql/catalyst/expressions/Expression.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/random.scala 21 additions, 2 deletions...la/org/apache/spark/sql/catalyst/expressions/random.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala 7 additions, 0 deletions...che/spark/sql/catalyst/expressions/stringOperations.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/StringKeyHashMap.scala 44 additions, 0 deletions...org/apache/spark/sql/catalyst/util/StringKeyHashMap.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 5 additions, 1 deletion...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala 42 additions, 0 deletionssql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala 3 additions, 6 deletions...rc/main/scala/org/apache/spark/sql/hive/HiveContext.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala 6 additions, 8 deletions...e/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala
Loading
Please register or sign in to comment