-
- Downloads
[SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns
Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which could take an optional `schema` to create an DataFrame from an RDD. The `schema` could be StructType or list of names of columns. Author: Davies Liu <davies@databricks.com> Closes #4498 from davies/create and squashes the following commits: 08469c1 [Davies Liu] remove Scala/Java API for now c80a7a9 [Davies Liu] fix hive test d1bd8f2 [Davies Liu] cleanup applySchema 9526e97 [Davies Liu] createDataFrame from RDD with columns
Showing
- docs/ml-guide.md 6 additions, 6 deletionsdocs/ml-guide.md
- docs/sql-programming-guide.md 8 additions, 8 deletionsdocs/sql-programming-guide.md
- examples/src/main/java/org/apache/spark/examples/ml/JavaCrossValidatorExample.java 2 additions, 2 deletions...g/apache/spark/examples/ml/JavaCrossValidatorExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaDeveloperApiExample.java 2 additions, 2 deletions...org/apache/spark/examples/ml/JavaDeveloperApiExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaSimpleParamsExample.java 2 additions, 2 deletions...org/apache/spark/examples/ml/JavaSimpleParamsExample.java
- examples/src/main/java/org/apache/spark/examples/ml/JavaSimpleTextClassificationPipeline.java 2 additions, 2 deletions...ark/examples/ml/JavaSimpleTextClassificationPipeline.java
- examples/src/main/java/org/apache/spark/examples/sql/JavaSparkSQL.java 1 addition, 1 deletion...main/java/org/apache/spark/examples/sql/JavaSparkSQL.java
- examples/src/main/python/sql.py 2 additions, 2 deletionsexamples/src/main/python/sql.py
- mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala 2 additions, 2 deletions...ain/scala/org/apache/spark/ml/tuning/CrossValidator.scala
- mllib/src/test/java/org/apache/spark/ml/JavaPipelineSuite.java 1 addition, 1 deletion.../src/test/java/org/apache/spark/ml/JavaPipelineSuite.java
- mllib/src/test/java/org/apache/spark/ml/classification/JavaLogisticRegressionSuite.java 1 addition, 1 deletion.../spark/ml/classification/JavaLogisticRegressionSuite.java
- mllib/src/test/java/org/apache/spark/ml/regression/JavaLinearRegressionSuite.java 1 addition, 1 deletion...apache/spark/ml/regression/JavaLinearRegressionSuite.java
- mllib/src/test/java/org/apache/spark/ml/tuning/JavaCrossValidatorSuite.java 1 addition, 1 deletion...a/org/apache/spark/ml/tuning/JavaCrossValidatorSuite.java
- python/pyspark/sql/context.py 67 additions, 20 deletionspython/pyspark/sql/context.py
- python/pyspark/sql/tests.py 13 additions, 13 deletionspython/pyspark/sql/tests.py
- sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala 85 additions, 10 deletions...core/src/main/scala/org/apache/spark/sql/SQLContext.scala
- sql/core/src/test/scala/org/apache/spark/sql/ColumnExpressionSuite.scala 2 additions, 2 deletions...st/scala/org/apache/spark/sql/ColumnExpressionSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala 5 additions, 4 deletions...e/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/PlannerSuite.scala 1 addition, 1 deletion...t/scala/org/apache/spark/sql/execution/PlannerSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCWriteSuite.scala 9 additions, 9 deletions...test/scala/org/apache/spark/sql/jdbc/JDBCWriteSuite.scala
Loading
Please register or sign in to comment