-
- Downloads
[SPARK-18429][SQL] implement a new Aggregate for CountMinSketch
## What changes were proposed in this pull request? This PR implements a new Aggregate to generate count min sketch, which is a wrapper of CountMinSketch. ## How was this patch tested? add test cases Author: wangzhenhua <wangzhenhua@huawei.com> Closes #15877 from wzhfy/cms.
Showing
- common/sketch/src/main/java/org/apache/spark/util/sketch/CountMinSketch.java 4 additions, 0 deletions...ain/java/org/apache/spark/util/sketch/CountMinSketch.java
- common/sketch/src/main/java/org/apache/spark/util/sketch/CountMinSketchImpl.java 24 additions, 6 deletions...java/org/apache/spark/util/sketch/CountMinSketchImpl.java
- common/sketch/src/test/scala/org/apache/spark/util/sketch/CountMinSketchSuite.scala 21 additions, 2 deletions...la/org/apache/spark/util/sketch/CountMinSketchSuite.scala
- sql/catalyst/pom.xml 5 additions, 0 deletionssql/catalyst/pom.xml
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala 1 addition, 0 deletions...apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/CountMinSketchAgg.scala 146 additions, 0 deletions...ql/catalyst/expressions/aggregate/CountMinSketchAgg.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/aggregate/CountMinSketchAggSuite.scala 320 additions, 0 deletions...talyst/expressions/aggregate/CountMinSketchAggSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/CountMinSketchAggQuerySuite.scala 189 additions, 0 deletions...la/org/apache/spark/sql/CountMinSketchAggQuerySuite.scala
Loading
Please register or sign in to comment