-
- Downloads
[SPARK-21281][SQL] Use string types by default if array and map have no argument
## What changes were proposed in this pull request? This pr modified code to use string types by default if `array` and `map` in functions have no argument. This behaviour is the same with Hive one; ``` hive> CREATE TEMPORARY TABLE t1 AS SELECT map(); hive> DESCRIBE t1; _c0 map<string,string> hive> CREATE TEMPORARY TABLE t2 AS SELECT array(); hive> DESCRIBE t2; _c0 array<string> ``` ## How was this patch tested? Added tests in `DataFrameFunctionsSuite`. Author: Takeshi Yamamuro <yamamuro@apache.org> Closes #18516 from maropu/SPARK-21281.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala 6 additions, 4 deletions...rg/apache/spark/sql/catalyst/expressions/arithmetic.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/complexTypeCreator.scala 21 additions, 14 deletions...e/spark/sql/catalyst/expressions/complexTypeCreator.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/hash.scala 3 additions, 2 deletions...cala/org/apache/spark/sql/catalyst/expressions/hash.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/nullExpressions.scala 4 additions, 3 deletions...ache/spark/sql/catalyst/expressions/nullExpressions.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/ExpressionTypeCheckingSuite.scala 2 additions, 2 deletions...k/sql/catalyst/analysis/ExpressionTypeCheckingSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/functions.scala 2 additions, 8 deletionssql/core/src/main/scala/org/apache/spark/sql/functions.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala 36 additions, 0 deletions.../scala/org/apache/spark/sql/DataFrameFunctionsSuite.scala
Loading
Please register or sign in to comment