-
- Downloads
[SPARK-15192][SQL] null check for SparkSession.createDataFrame
## What changes were proposed in this pull request? This PR adds null check in `SparkSession.createDataFrame`, so that we can make sure the passed in rows matches the given schema. ## How was this patch tested? new tests in `DatasetSuite` Author: Wenchen Fan <wenchen@databricks.com> Closes #13008 from cloud-fan/row-encoder.
Showing
- mllib/src/main/scala/org/apache/spark/mllib/fpm/FPGrowth.scala 1 addition, 1 deletion.../src/main/scala/org/apache/spark/mllib/fpm/FPGrowth.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala 2 additions, 2 deletions...scala/org/apache/spark/sql/catalyst/ScalaReflection.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala 3 additions, 7 deletions...a/org/apache/spark/sql/catalyst/encoders/RowEncoder.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala 1 addition, 1 deletion...pache/spark/sql/catalyst/expressions/BoundAttribute.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala 3 additions, 1 deletion...ache/spark/sql/catalyst/expressions/objects/objects.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 2 additions, 2 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
- sql/core/src/main/scala/org/apache/spark/sql/api/r/SQLUtils.scala 4 additions, 1 deletion.../src/main/scala/org/apache/spark/sql/api/r/SQLUtils.scala
- sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala 11 additions, 2 deletions...re/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala 1 addition, 5 deletions...c/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala
Loading
Please register or sign in to comment