-
- Downloads
[SPARK-19893][SQL] should not run DataFrame set oprations with map type
In spark SQL, map type can't be used in equality test/comparison, and `Intersect`/`Except`/`Distinct` do need equality test for all columns, we should not allow map type in `Intersect`/`Except`/`Distinct`. new regression test Author: Wenchen Fan <wenchen@databricks.com> Closes #17236 from cloud-fan/map. (cherry picked from commit fb9beda5) Signed-off-by:Wenchen Fan <wenchen@databricks.com>
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala 20 additions, 4 deletions...rg/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala 16 additions, 0 deletions.../src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/InMemoryColumnarQuerySuite.scala 6 additions, 8 deletions...k/sql/execution/columnar/InMemoryColumnarQuerySuite.scala
Loading
Please register or sign in to comment