Skip to content
Snippets Groups Projects
  • Davies Liu's avatar
    1056c5b1
    [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns · 1056c5b1
    Davies Liu authored
    
    Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which could take an optional `schema` to create an DataFrame from an RDD. The `schema` could be StructType or list of names of columns.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #4498 from davies/create and squashes the following commits:
    
    08469c1 [Davies Liu] remove Scala/Java API for now
    c80a7a9 [Davies Liu] fix hive test
    d1bd8f2 [Davies Liu] cleanup applySchema
    9526e97 [Davies Liu] createDataFrame from RDD with columns
    
    (cherry picked from commit ea602840)
    Signed-off-by: default avatarMichael Armbrust <michael@databricks.com>
    1056c5b1
    History
    [SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns
    Davies Liu authored
    
    Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which could take an optional `schema` to create an DataFrame from an RDD. The `schema` could be StructType or list of names of columns.
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #4498 from davies/create and squashes the following commits:
    
    08469c1 [Davies Liu] remove Scala/Java API for now
    c80a7a9 [Davies Liu] fix hive test
    d1bd8f2 [Davies Liu] cleanup applySchema
    9526e97 [Davies Liu] createDataFrame from RDD with columns
    
    (cherry picked from commit ea602840)
    Signed-off-by: default avatarMichael Armbrust <michael@databricks.com>