Skip to content
  • Cheng Lian's avatar
    2d45571f
    [SPARK-8959] [SQL] [HOTFIX] Removes parquet-thrift and libthrift dependencies · 2d45571f
    Cheng Lian authored
    These two dependencies were introduced in #7231 to help testing Parquet compatibility with `parquet-thrift`. However, they somehow crash the Scala compiler in Maven builds.
    
    This PR fixes this issue by:
    
    1. Removing these two dependencies, and
    2. Instead of generating the testing Parquet file programmatically, checking in an actual testing Parquet file generated by `parquet-thrift` as a test resource.
    
    This is just a quick fix to bring back Maven builds. Need to figure out the root case as binary Parquet files are harder to maintain.
    
    Author: Cheng Lian <lian@databricks.com>
    
    Closes #7330 from liancheng/spark-8959 and squashes the following commits:
    
    cf69512 [Cheng Lian] Brings back Maven builds
    2d45571f
    [SPARK-8959] [SQL] [HOTFIX] Removes parquet-thrift and libthrift dependencies
    Cheng Lian authored
    These two dependencies were introduced in #7231 to help testing Parquet compatibility with `parquet-thrift`. However, they somehow crash the Scala compiler in Maven builds.
    
    This PR fixes this issue by:
    
    1. Removing these two dependencies, and
    2. Instead of generating the testing Parquet file programmatically, checking in an actual testing Parquet file generated by `parquet-thrift` as a test resource.
    
    This is just a quick fix to bring back Maven builds. Need to figure out the root case as binary Parquet files are harder to maintain.
    
    Author: Cheng Lian <lian@databricks.com>
    
    Closes #7330 from liancheng/spark-8959 and squashes the following commits:
    
    cf69512 [Cheng Lian] Brings back Maven builds
Loading