-
- Downloads
[SPARK-13790] Speed up ColumnVector's getDecimal
## What changes were proposed in this pull request? We should reuse an object similar to the other non-primitive type getters. For a query that computes averages over decimal columns, this shows a 10% speedup on overall query times. ## How was this patch tested? Existing tests and this benchmark ``` TPCDS Snappy: Best/Avg Time(ms) Rate(M/s) Per Row(ns) -------------------------------------------------------------------------------- q27-agg (master) 10627 / 11057 10.8 92.3 q27-agg (this patch) 9722 / 9832 11.8 84.4 ``` Author: Nong Li <nong@databricks.com> Closes #11624 from nongli/spark-13790.
Showing
- sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java 1 addition, 1 deletion.../org/apache/spark/sql/catalyst/expressions/UnsafeRow.java
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/Decimal.scala 11 additions, 0 deletions...t/src/main/scala/org/apache/spark/sql/types/Decimal.scala
- sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java 2 additions, 2 deletions...g/apache/spark/sql/execution/vectorized/ColumnVector.java
Please register or sign in to comment