-
- Downloads
[SPARK-18103][SQL] Rename *FileCatalog to *FileIndex
## What changes were proposed in this pull request? To reduce the number of components in SQL named *Catalog, rename *FileCatalog to *FileIndex. A FileIndex is responsible for returning the list of partitions / files to scan given a filtering expression. ``` TableFileCatalog => CatalogFileIndex FileCatalog => FileIndex ListingFileCatalog => InMemoryFileIndex MetadataLogFileCatalog => MetadataLogFileIndex PrunedTableFileCatalog => PrunedInMemoryFileIndex ``` cc yhuai marmbrus ## How was this patch tested? N/A Author: Eric Liang <ekl@databricks.com> Author: Eric Liang <ekhliang@gmail.com> Closes #15634 from ericl/rename-file-provider.
Showing
- core/src/main/scala/org/apache/spark/metrics/source/StaticSources.scala 1 addition, 1 deletion...scala/org/apache/spark/metrics/source/StaticSources.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala 1 addition, 1 deletion...n/scala/org/apache/spark/sql/execution/CacheManager.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/CatalogFileIndex.scala 12 additions, 12 deletions...he/spark/sql/execution/datasources/CatalogFileIndex.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala 5 additions, 5 deletions...g/apache/spark/sql/execution/datasources/DataSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileIndex.scala 1 addition, 1 deletion...rg/apache/spark/sql/execution/datasources/FileIndex.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/HadoopFsRelation.scala 2 additions, 2 deletions...he/spark/sql/execution/datasources/HadoopFsRelation.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala 4 additions, 4 deletions...e/spark/sql/execution/datasources/InMemoryFileIndex.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningAwareFileIndex.scala 8 additions, 8 deletions...ql/execution/datasources/PartitioningAwareFileIndex.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PruneFileSourcePartitions.scala 3 additions, 3 deletions...sql/execution/datasources/PruneFileSourcePartitions.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/CompactibleFileStreamLog.scala 2 additions, 2 deletions...rk/sql/execution/streaming/CompactibleFileStreamLog.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FileStreamSource.scala 2 additions, 2 deletions...ache/spark/sql/execution/streaming/FileStreamSource.scala
- sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/MetadataLogFileCatalog.scala 3 additions, 3 deletions...park/sql/execution/streaming/MetadataLogFileCatalog.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileCatalogSuite.scala 18 additions, 18 deletions...he/spark/sql/execution/datasources/FileCatalogSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala 1 addition, 1 deletion...k/sql/execution/datasources/FileSourceStrategySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala 1 addition, 1 deletion.../datasources/parquet/ParquetPartitionDiscoverySuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSinkSuite.scala 3 additions, 3 deletions.../org/apache/spark/sql/streaming/FileStreamSinkSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala 1 addition, 1 deletion...rg/apache/spark/sql/streaming/FileStreamSourceSuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala 2 additions, 2 deletions...cala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/CachedTableSuite.scala 5 additions, 5 deletions...st/scala/org/apache/spark/sql/hive/CachedTableSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala 1 addition, 1 deletion...pache/spark/sql/hive/PartitionedTablePerfStatsSuite.scala
Loading
Please register or sign in to comment