Skip to content
Snippets Groups Projects
Commit 13785daa authored by Dilip Biswal's avatar Dilip Biswal Committed by gatorsmile
Browse files

[SPARK-21599][SQL] Collecting column statistics for datasource tables may fail...

[SPARK-21599][SQL] Collecting column statistics for datasource tables may fail with java.util.NoSuchElementException

## What changes were proposed in this pull request?
In case of datasource tables (when they are stored in non-hive compatible way) , the schema information is recorded as table properties in hive meta-store. The alterTableStats method needs to get the schema information from table properties for data source tables before recording the column level statistics. Currently, we don't get the correct schema information and fail with java.util.NoSuchElement exception.

## How was this patch tested?
A new test case is added in StatisticsSuite.

Author: Dilip Biswal <dbiswal@us.ibm.com>

Closes #18804 from dilipbiswal/datasource_stats.
parent 97ba4918
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment