Skip to content
Snippets Groups Projects
  • Davies Liu's avatar
    4a581aa3
    [SPARK-5859] [PySpark] [SQL] fix DataFrame Python API · 4a581aa3
    Davies Liu authored
    
    1. added explain()
    2. add isLocal()
    3. do not call show() in __repl__
    4. add foreach() and foreachPartition()
    5. add distinct()
    6. fix functions.col()/column()/lit()
    7. fix unit tests in sql/functions.py
    8. fix unicode in showString()
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #4645 from davies/df6 and squashes the following commits:
    
    6b46a2c [Davies Liu] fix DataFrame Python API
    
    (cherry picked from commit d8adefef)
    Signed-off-by: default avatarMichael Armbrust <michael@databricks.com>
    4a581aa3
    History
    [SPARK-5859] [PySpark] [SQL] fix DataFrame Python API
    Davies Liu authored
    
    1. added explain()
    2. add isLocal()
    3. do not call show() in __repl__
    4. add foreach() and foreachPartition()
    5. add distinct()
    6. fix functions.col()/column()/lit()
    7. fix unit tests in sql/functions.py
    8. fix unicode in showString()
    
    Author: Davies Liu <davies@databricks.com>
    
    Closes #4645 from davies/df6 and squashes the following commits:
    
    6b46a2c [Davies Liu] fix DataFrame Python API
    
    (cherry picked from commit d8adefef)
    Signed-off-by: default avatarMichael Armbrust <michael@databricks.com>