-
- Downloads
[SPARK-14487][SQL] User Defined Type registration without SQLUserDefinedType annotation
## What changes were proposed in this pull request? Currently we use `SQLUserDefinedType` annotation to register UDTs for user classes. However, by doing this, we add Spark dependency to user classes. For some user classes, it is unnecessary to add such dependency that will increase deployment difficulty. We should provide alternative approach to register UDTs for user classes without `SQLUserDefinedType` annotation. ## How was this patch tested? `UserDefinedTypeSuite` Author: Liang-Chi Hsieh <simonh@tw.ibm.com> Closes #12259 from viirya/improve-sql-usertype.
Showing
- mllib/src/main/scala/org/apache/spark/ml/linalg/MatrixUDT.scala 111 additions, 0 deletions...src/main/scala/org/apache/spark/ml/linalg/MatrixUDT.scala
- mllib/src/main/scala/org/apache/spark/ml/linalg/VectorUDT.scala 98 additions, 0 deletions...src/main/scala/org/apache/spark/ml/linalg/VectorUDT.scala
- mllib/src/test/scala/org/apache/spark/ml/linalg/MatrixUDTSuite.scala 41 additions, 0 deletions...est/scala/org/apache/spark/ml/linalg/MatrixUDTSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/linalg/VectorUDTSuite.scala 39 additions, 0 deletions...est/scala/org/apache/spark/ml/linalg/VectorUDTSuite.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 23 additions, 0 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala 23 additions, 4 deletions...a/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/UDTRegistration.scala 89 additions, 0 deletions...in/scala/org/apache/spark/sql/types/UDTRegistration.scala
- sql/core/src/test/scala/org/apache/spark/sql/UDTRegistrationSuite.scala 89 additions, 0 deletions...est/scala/org/apache/spark/sql/UDTRegistrationSuite.scala
Loading
Please register or sign in to comment