-
- Downloads
[SPARK-5677] [SPARK-5734] [SQL] [PySpark] Python DataFrame API remaining tasks
1. DataFrame.renameColumn 2. DataFrame.show() and _repr_ 3. Use simpleString() rather than jsonValue in DataFrame.dtypes 4. createDataFrame from local Python data, including pandas.DataFrame Author: Davies Liu <davies@databricks.com> Closes #4528 from davies/df3 and squashes the following commits: 014acea [Davies Liu] fix typo 6ba526e [Davies Liu] fix tests 46f5f95 [Davies Liu] address comments 6cbc154 [Davies Liu] dataframe.show() and improve dtypes 6f94f25 [Davies Liu] create DataFrame from local Python data
Showing
- python/pyspark/sql/context.py 72 additions, 42 deletionspython/pyspark/sql/context.py
- python/pyspark/sql/dataframe.py 39 additions, 3 deletionspython/pyspark/sql/dataframe.py
- python/pyspark/sql/tests.py 1 addition, 1 deletionpython/pyspark/sql/tests.py
- python/pyspark/sql/types.py 32 additions, 0 deletionspython/pyspark/sql/types.py
- sql/core/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala 11 additions, 4 deletions...e/src/main/scala/org/apache/spark/sql/DataFrameImpl.scala
Loading
Please register or sign in to comment