-
- Downloads
[MINOR][SQL][DOCS] Add notes of the deterministic assumption on UDF functions
## What changes were proposed in this pull request? Spark assumes that UDF functions are deterministic. This PR adds explicit notes about that. ## How was this patch tested? It's only about docs. Author: Dongjoon Hyun <dongjoon@apache.org> Closes #13087 from dongjoon-hyun/SPARK-15282.
Showing
- python/pyspark/sql/functions.py 3 additions, 0 deletionspython/pyspark/sql/functions.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala 1 addition, 0 deletions.../org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 3 additions, 0 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 3 additions, 0 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
- sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala 1 addition, 0 deletions...src/main/scala/org/apache/spark/sql/UDFRegistration.scala
- sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala 3 additions, 0 deletions...rg/apache/spark/sql/expressions/UserDefinedFunction.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/SessionState.scala 1 addition, 0 deletions...in/scala/org/apache/spark/sql/internal/SessionState.scala
Loading
Please register or sign in to comment