-
- Downloads
[SPARK-12398] Smart truncation of DataFrame / Dataset toString
When a DataFrame or Dataset has a long schema, we should intelligently truncate to avoid flooding the screen with unreadable information. // Standard output [a: int, b: int] // Truncate many top level fields [a: int, b, string ... 10 more fields] // Truncate long inner structs [a: struct<a: Int ... 10 more fields>] Author: Dilip Biswal <dbiswal@us.ibm.com> Closes #10373 from dilipbiswal/spark-12398.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/DataType.scala 3 additions, 0 deletions.../src/main/scala/org/apache/spark/sql/types/DataType.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala 17 additions, 0 deletions...rc/main/scala/org/apache/spark/sql/types/StructType.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/Queryable.scala 14 additions, 1 deletion...main/scala/org/apache/spark/sql/execution/Queryable.scala
- sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala 39 additions, 0 deletions.../src/test/scala/org/apache/spark/sql/DataFrameSuite.scala
Loading
Please register or sign in to comment