-
- Downloads
[SPARK-18127] Add hooks and extension points to Spark
## What changes were proposed in this pull request? This patch adds support for customizing the spark session by injecting user-defined custom extensions. This allows a user to add custom analyzer rules/checks, optimizer rules, planning strategies or even a customized parser. ## How was this patch tested? Unit Tests in SparkSessionExtensionSuite Author: Sameer Agarwal <sameerag@cs.berkeley.edu> Closes #17724 from sameeragarwal/session-extensions.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParseDriver.scala 5 additions, 4 deletions...la/org/apache/spark/sql/catalyst/parser/ParseDriver.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/ParserInterface.scala 28 additions, 7 deletions...rg/apache/spark/sql/catalyst/parser/ParserInterface.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/internal/StaticSQLConf.scala 6 additions, 0 deletions...n/scala/org/apache/spark/sql/internal/StaticSQLConf.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 39 additions, 6 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSessionExtensions.scala 171 additions, 0 deletions...n/scala/org/apache/spark/sql/SparkSessionExtensions.scala
- sql/core/src/main/scala/org/apache/spark/sql/internal/BaseSessionStateBuilder.scala 25 additions, 8 deletions...g/apache/spark/sql/internal/BaseSessionStateBuilder.scala
- sql/core/src/test/scala/org/apache/spark/sql/SparkSessionExtensionSuite.scala 144 additions, 0 deletions...ala/org/apache/spark/sql/SparkSessionExtensionSuite.scala
Loading
Please register or sign in to comment