-
- Downloads
[SPARK-14642][SQL] import org.apache.spark.sql.expressions._ breaks udf under functions
## What changes were proposed in this pull request? PR fixes the import issue which breaks udf functions. The following code snippet throws an error ``` scala> import org.apache.spark.sql.functions._ import org.apache.spark.sql.functions._ scala> import org.apache.spark.sql.expressions._ import org.apache.spark.sql.expressions._ scala> udf((v: String) => v.stripSuffix("-abc")) <console>:30: error: No TypeTag available for String udf((v: String) => v.stripSuffix("-abc")) ``` This PR resolves the issue. ## How was this patch tested? patch tested with unit tests. (If this patch involves UI changes, please attach a screenshot; otherwise, remove this) Author: Subhobrata Dey <sbcd90@gmail.com> Closes #12458 from sbcd90/udfFuncBreak.
Showing
- external/java8-tests/src/test/java/org/apache/spark/sql/Java8DatasetAggregatorSuite.java 1 addition, 1 deletion...ava/org/apache/spark/sql/Java8DatasetAggregatorSuite.java
- sql/core/src/main/java/org/apache/spark/sql/expressions/javalang/typed.java 2 additions, 2 deletions...java/org/apache/spark/sql/expressions/javalang/typed.java
- sql/core/src/main/scala/org/apache/spark/sql/expressions/scalalang/typed.scala 2 additions, 2 deletions...la/org/apache/spark/sql/expressions/scalalang/typed.scala
- sql/core/src/test/java/test/org/apache/spark/sql/sources/JavaDatasetAggregatorSuite.java 1 addition, 1 deletion.../apache/spark/sql/sources/JavaDatasetAggregatorSuite.java
- sql/core/src/test/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala 1 addition, 1 deletion...t/scala/org/apache/spark/sql/DatasetAggregatorSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/DatasetBenchmark.scala 1 addition, 1 deletion...rc/test/scala/org/apache/spark/sql/DatasetBenchmark.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala 1 addition, 1 deletion...g/apache/spark/sql/execution/WholeStageCodegenSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingAggregationSuite.scala 1 addition, 1 deletion...pache/spark/sql/streaming/StreamingAggregationSuite.scala
Please register or sign in to comment