Skip to content
Snippets Groups Projects
Commit 2e1fd46e authored by jtoka's avatar jtoka Committed by Sean Owen
Browse files

[SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

## What changes were proposed in this pull request?
Update count distinct error message for streaming datasets/dataframes to match current behavior. These aggregations are not yet supported, regardless of whether the dataset/dataframe is aggregated.

Author: jtoka <jason.tokayer@gmail.com>

Closes #17609 from jtoka/master.
parent ffc57b01
No related branches found
No related tags found
No related merge requests found
...@@ -139,9 +139,8 @@ object UnsupportedOperationChecker { ...@@ -139,9 +139,8 @@ object UnsupportedOperationChecker {
} }
throwErrorIf( throwErrorIf(
child.isStreaming && distinctAggExprs.nonEmpty, child.isStreaming && distinctAggExprs.nonEmpty,
"Distinct aggregations are not supported on streaming DataFrames/Datasets, unless " + "Distinct aggregations are not supported on streaming DataFrames/Datasets. Consider " +
"it is on aggregated DataFrame/Dataset in Complete output mode. Consider using " + "using approx_count_distinct() instead.")
"approximate distinct aggregation (e.g. approx_count_distinct() instead of count()).")
case _: Command => case _: Command =>
throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " + throwError("Commands like CreateTable*, AlterTable*, Show* are not supported with " +
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment