-
- Downloads
[SPARK-14476][SQL] Improve the physical plan visualization by adding meta info...
[SPARK-14476][SQL] Improve the physical plan visualization by adding meta info like table name and file path for data source. ## What changes were proposed in this pull request? Improve the physical plan visualization by adding meta info like table name and file path for data source. Meta info InputPaths and TableName are newly added. Example: ``` scala> spark.range(10).write.saveAsTable("tt") scala> spark.sql("select * from tt").explain() == Physical Plan == WholeStageCodegen : +- BatchedScan HadoopFiles[id#13L] Format: ParquetFormat, InputPaths: file:/home/xzhong10/spark-linux/assembly/spark-warehouse/tt, PushedFilters: [], ReadSchema: struct<id:bigint>, TableName: default.tt ``` ## How was this patch tested? manual tests. Changes for UI: Before:  After:   Author: Sean Zhong <clockfly@gmail.com> Closes #12947 from clockfly/spark-14476.
Showing
- sql/core/src/main/resources/org/apache/spark/sql/execution/ui/static/spark-sql-viz.css 5 additions, 0 deletions...rg/apache/spark/sql/execution/ui/static/spark-sql-viz.css
- sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala 26 additions, 11 deletions...in/scala/org/apache/spark/sql/execution/ExistingRDD.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala 2 additions, 7 deletions.../spark/sql/execution/datasources/DataSourceStrategy.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategy.scala 13 additions, 6 deletions.../spark/sql/execution/datasources/FileSourceStrategy.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/fileSourceInterfaces.scala 7 additions, 3 deletions...park/sql/execution/datasources/fileSourceInterfaces.scala
Loading
Please register or sign in to comment