-
- Downloads
[SPARK-20067][SQL] Unify and Clean Up Desc Commands Using Catalog Interface
### What changes were proposed in this pull request? This PR is to unify and clean up the outputs of `DESC EXTENDED/FORMATTED` and `SHOW TABLE EXTENDED` by moving the logics into the Catalog interface. The output formats are improved. We also add the missing attributes. It impacts the DDL commands like `SHOW TABLE EXTENDED`, `DESC EXTENDED` and `DESC FORMATTED`. In addition, by following what we did in Dataset API `printSchema`, we can use `treeString` to show the schema in the more readable way. Below is the current way: ``` Schema: STRUCT<`a`: STRING (nullable = true), `b`: INT (nullable = true), `c`: STRING (nullable = true), `d`: STRING (nullable = true)> ``` After the change, it should look like ``` Schema: root |-- a: string (nullable = true) |-- b: integer (nullable = true) |-- c: string (nullable = true) |-- d: string (nullable = true) ``` ### How was this patch tested? `describe.sql` and `show-tables.sql` Author: Xiao Li <gatorsmile@gmail.com> Closes #17394 from gatorsmile/descFollowUp.
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala 87 additions, 49 deletions...ala/org/apache/spark/sql/catalyst/catalog/interface.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala 1 addition, 2 deletions...scala/org/apache/spark/sql/execution/SparkSqlParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala 27 additions, 97 deletions...scala/org/apache/spark/sql/execution/command/tables.scala
- sql/core/src/test/resources/sql-tests/inputs/describe.sql 50 additions, 3 deletionssql/core/src/test/resources/sql-tests/inputs/describe.sql
- sql/core/src/test/resources/sql-tests/results/change-column.sql.out 9 additions, 0 deletions...rc/test/resources/sql-tests/results/change-column.sql.out
- sql/core/src/test/resources/sql-tests/results/describe.sql.out 330 additions, 92 deletions...ore/src/test/resources/sql-tests/results/describe.sql.out
- sql/core/src/test/resources/sql-tests/results/show-tables.sql.out 36 additions, 31 deletions.../src/test/resources/sql-tests/results/show-tables.sql.out
- sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala 11 additions, 8 deletions...c/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala 3 additions, 3 deletions.../org/apache/spark/sql/execution/SparkSqlParserSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala 0 additions, 12 deletions...ala/org/apache/spark/sql/execution/command/DDLSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala 0 additions, 4 deletions.../src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/DDLTestSuite.scala 0 additions, 123 deletions...est/scala/org/apache/spark/sql/sources/DDLTestSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/sources/DataSourceTest.scala 56 additions, 0 deletions...t/scala/org/apache/spark/sql/sources/DataSourceTest.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala 4 additions, 4 deletions...org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveComparisonTest.scala 3 additions, 1 deletion.../apache/spark/sql/hive/execution/HiveComparisonTest.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala 1 addition, 92 deletions...la/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveOperatorQueryableSuite.scala 0 additions, 53 deletions...spark/sql/hive/execution/HiveOperatorQueryableSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala 0 additions, 56 deletions.../org/apache/spark/sql/hive/execution/HiveQuerySuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala 24 additions, 107 deletions...a/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala
Loading
Please register or sign in to comment