-
- Downloads
[SPARK-16192][SQL] Add type checks in CollectSet
## What changes were proposed in this pull request? `CollectSet` cannot have map-typed data because MapTypeData does not implement `equals`. So, this pr is to add type checks in `CheckAnalysis`. ## How was this patch tested? Added tests to check failures when we found map-typed data in `CollectSet`. Author: Takeshi YAMAMURO <linguin.m.s@gmail.com> Closes #13892 from maropu/SPARK-16192.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala 2 additions, 2 deletions...rg/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/collect.scala 9 additions, 0 deletions...he/spark/sql/catalyst/expressions/aggregate/collect.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala 10 additions, 0 deletions.../scala/org/apache/spark/sql/DataFrameAggregateSuite.scala
Loading
Please register or sign in to comment