-
- Downloads
[SPARK-4798][SQL] A new set of Parquet testing API and test suites
This PR provides a set Parquet testing API (see trait `ParquetTest`) that enables developers to write more concise test cases. A new set of Parquet test suites built upon this API are added and aim to replace the old `ParquetQuerySuite`. To avoid potential merge conflicts, old testing code are not removed yet. The following classes can be safely removed after most Parquet related PRs are handled: - `ParquetQuerySuite` - `ParquetTestData` <!-- Reviewable:start --> [<img src="https://reviewable.io/review_button.png" height=40 alt="Review on Reviewable"/>](https://reviewable.io/reviews/apache/spark/3644) <!-- Reviewable:end --> Author: Cheng Lian <lian@databricks.com> Closes #3644 from liancheng/parquet-tests and squashes the following commits: 800e745 [Cheng Lian] Enforces ordering of test output 3bb8731 [Cheng Lian] Refactors HiveParquetSuite aa2cb2e [Cheng Lian] Decouples ParquetTest and TestSQLContext 7b43a68 [Cheng Lian] Updates ParquetTest Scaladoc 7f07af0 [Cheng Lian] Adds a new set of Parquet test suites
Showing
- sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala 4 additions, 0 deletionssql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala
- sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTest.scala 127 additions, 0 deletions...main/scala/org/apache/spark/sql/parquet/ParquetTest.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala 253 additions, 0 deletions...ala/org/apache/spark/sql/parquet/ParquetFilterSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala 287 additions, 0 deletions...t/scala/org/apache/spark/sql/parquet/ParquetIOSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite2.scala 110 additions, 0 deletions...ala/org/apache/spark/sql/parquet/ParquetQuerySuite2.scala
- sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetSchemaSuite.scala 164 additions, 0 deletions...ala/org/apache/spark/sql/parquet/ParquetSchemaSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/parquet/HiveParquetSuite.scala 41 additions, 78 deletions...scala/org/apache/spark/sql/parquet/HiveParquetSuite.scala
- sql/hive/src/test/scala/org/apache/spark/sql/parquet/parquetSuites.scala 3 additions, 3 deletions...st/scala/org/apache/spark/sql/parquet/parquetSuites.scala
Loading
Please register or sign in to comment