-
- Downloads
[SPARK-20961][SQL] generalize the dictionary in ColumnVector
## What changes were proposed in this pull request? As the first step of https://issues.apache.org/jira/browse/SPARK-20960 , to make `ColumnVector` public, this PR generalize `ColumnVector.dictionary` to not couple with parquet. ## How was this patch tested? existing tests Author: Wenchen Fan <wenchen@databricks.com> Closes #18183 from cloud-fan/dictionary.
Showing
- sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetDictionary.java 53 additions, 0 deletions.../sql/execution/datasources/parquet/ParquetDictionary.java
- sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedColumnReader.java 1 addition, 1 deletion...execution/datasources/parquet/VectorizedColumnReader.java
- sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/VectorizedParquetRecordReader.java 7 additions, 10 deletions...on/datasources/parquet/VectorizedParquetRecordReader.java
- sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/ColumnVector.java 5 additions, 10 deletions...g/apache/spark/sql/execution/vectorized/ColumnVector.java
- sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/Dictionary.java 34 additions, 0 deletions...org/apache/spark/sql/execution/vectorized/Dictionary.java
Loading
Please register or sign in to comment