-
- Downloads
[SPARK-9022] [SQL] Generated projections for UnsafeRow
Added two projections: GenerateUnsafeProjection and FromUnsafeProjection, which could be used to convert UnsafeRow from/to GenericInternalRow. They will re-use the buffer during projection, similar to MutableProjection (without all the interface MutableProjection has). cc rxin JoshRosen Author: Davies Liu <davies@databricks.com> Closes #7437 from davies/unsafe_proj2 and squashes the following commits: dbf538e [Davies Liu] test with all the expression (only for supported types) dc737b2 [Davies Liu] address comment e424520 [Davies Liu] fix scala style 70e231c [Davies Liu] address comments 729138d [Davies Liu] Merge branch 'master' of github.com:apache/spark into unsafe_proj2 5a26373 [Davies Liu] unsafe projections
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowSorter.java 9 additions, 18 deletions...g/apache/spark/sql/execution/UnsafeExternalRowSorter.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala 4 additions, 4 deletions...cala/org/apache/spark/sql/catalyst/expressions/Cast.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Projection.scala 35 additions, 0 deletions...rg/apache/spark/sql/catalyst/expressions/Projection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/UnsafeRowConverter.scala 39 additions, 30 deletions...e/spark/sql/catalyst/expressions/UnsafeRowConverter.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala 9 additions, 6 deletions...park/sql/catalyst/expressions/codegen/CodeGenerator.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateProjection.scala 2 additions, 2 deletions...sql/catalyst/expressions/codegen/GenerateProjection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GenerateUnsafeProjection.scala 125 additions, 0 deletions...talyst/expressions/codegen/GenerateUnsafeProjection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/decimalFunctions.scala 1 addition, 1 deletion...che/spark/sql/catalyst/expressions/decimalFunctions.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/math.scala 1 addition, 1 deletion...cala/org/apache/spark/sql/catalyst/expressions/math.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala 8 additions, 9 deletions...cala/org/apache/spark/sql/catalyst/expressions/misc.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala 33 additions, 1 deletion...spark/sql/catalyst/expressions/ExpressionEvalHelper.scala
Loading
Please register or sign in to comment