-
- Downloads
[SPARK-16128][SQL] Allow setting length of characters to be truncated to, in Dataset.show function.
## What changes were proposed in this pull request? Allowing truncate to a specific number of character is convenient at times, especially while operating from the REPL. Sometimes those last few characters make all the difference, and showing everything brings in whole lot of noise. ## How was this patch tested? Existing tests. + 1 new test in DataFrameSuite. For SparkR and pyspark, existing tests and manual testing. Author: Prashant Sharma <prashsh1@in.ibm.com> Author: Prashant Sharma <prashant@apache.org> Closes #13839 from ScrapCodes/add_truncateTo_DF.show.
Showing
- .gitignore 1 addition, 0 deletions.gitignore
- R/pkg/R/DataFrame.R 8 additions, 3 deletionsR/pkg/R/DataFrame.R
- R/pkg/inst/tests/testthat/test_sparkSQL.R 8 additions, 0 deletionsR/pkg/inst/tests/testthat/test_sparkSQL.R
- python/pyspark/sql/dataframe.py 15 additions, 3 deletionspython/pyspark/sql/dataframe.py
- sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala 40 additions, 7 deletionssql/core/src/main/scala/org/apache/spark/sql/Dataset.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala 24 additions, 3 deletions.../src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala 1 addition, 1 deletion...re/src/test/scala/org/apache/spark/sql/DatasetSuite.scala
Loading
Please register or sign in to comment