-
- Downloads
[SPARK-14061][SQL] implement CreateMap
## What changes were proposed in this pull request? As we have `CreateArray` and `CreateStruct`, we should also have `CreateMap`. This PR adds the `CreateMap` expression, and the DataFrame API, and python API. ## How was this patch tested? various new tests. Author: Wenchen Fan <wenchen@databricks.com> Closes #11879 from cloud-fan/create_map.
Showing
- python/pyspark/sql/functions.py 20 additions, 0 deletionspython/pyspark/sql/functions.py
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala 1 addition, 0 deletions...apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala 31 additions, 4 deletions...apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala 82 additions, 1 deletion...e/spark/sql/catalyst/expressions/complexTypeCreator.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/ArrayBasedMapData.scala 2 additions, 3 deletions...rg/apache/spark/sql/catalyst/util/ArrayBasedMapData.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/ExpressionTypeCheckingSuite.scala 13 additions, 3 deletions...k/sql/catalyst/analysis/ExpressionTypeCheckingSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercionSuite.scala 61 additions, 0 deletions...e/spark/sql/catalyst/analysis/HiveTypeCoercionSuite.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala 40 additions, 0 deletions...che/spark/sql/catalyst/expressions/ComplexTypeSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 11 additions, 0 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala 7 additions, 1 deletion...cala/org/apache/spark/sql/DataFrameComplexTypeSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala 8 additions, 7 deletions.../scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/ExpressionToSQLSuite.scala 1 addition, 0 deletions...cala/org/apache/spark/sql/hive/ExpressionToSQLSuite.scala
Loading
Please register or sign in to comment