-
- Downloads
[SPARK-9738] [SQL] remove FromUnsafe and add its codegen version to GenerateSafe
In https://github.com/apache/spark/pull/7752 we added `FromUnsafe` to convert nexted unsafe data like array/map/struct to safe versions. It's a quick solution and we already have `GenerateSafe` to do the conversion which is codegened. So we should remove `FromUnsafe` and implement its codegen version in `GenerateSafe`. Author: Wenchen Fan <cloud0fan@outlook.com> Closes #8029 from cloud-fan/from-unsafe and squashes the following commits: ed40d8f [Wenchen Fan] add the copy back a93fd4b [Wenchen Fan] cogengen FromUnsafe
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/FromUnsafe.scala 0 additions, 70 deletions...rg/apache/spark/sql/catalyst/expressions/FromUnsafe.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala 1 addition, 7 deletions...rg/apache/spark/sql/catalyst/expressions/Projection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateSafeProjection.scala 91 additions, 29 deletions...catalyst/expressions/codegen/GenerateSafeProjection.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/RowFormatConvertersSuite.scala 3 additions, 1 deletion...apache/spark/sql/execution/RowFormatConvertersSuite.scala
Loading
Please register or sign in to comment