-
- Downloads
[SPARK-13674] [SQL] Add wholestage codegen support to Sample
JIRA: https://issues.apache.org/jira/browse/SPARK-13674 ## What changes were proposed in this pull request? Sample operator doesn't support wholestage codegen now. This pr is to add support to it. ## How was this patch tested? A test is added into `BenchmarkWholeStageCodegen`. Besides, all tests should be passed. Author: Liang-Chi Hsieh <simonh@tw.ibm.com> Author: Liang-Chi Hsieh <viirya@gmail.com> Closes #11517 from viirya/add-wholestage-sample.
Showing
- core/src/main/scala/org/apache/spark/util/random/RandomSampler.scala 1 addition, 1 deletion...in/scala/org/apache/spark/util/random/RandomSampler.scala
- project/MimaExcludes.scala 4 additions, 0 deletionsproject/MimaExcludes.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java 3 additions, 1 deletion...a/org/apache/spark/sql/execution/BufferedRowIterator.java
- sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegen.scala 7 additions, 5 deletions...la/org/apache/spark/sql/execution/WholeStageCodegen.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala 64 additions, 8 deletions...scala/org/apache/spark/sql/execution/basicOperators.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/BenchmarkWholeStageCodegen.scala 25 additions, 0 deletions...ache/spark/sql/execution/BenchmarkWholeStageCodegen.scala
Loading
Please register or sign in to comment