Skip to content
Snippets Groups Projects
Commit 14b6a9d3 authored by Dongjoon Hyun's avatar Dongjoon Hyun Committed by Xiao Li
Browse files

[SPARK-20735][SQL][TEST] Enable cross join in TPCDSQueryBenchmark

## What changes were proposed in this pull request?

Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298

), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`.

## How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

Author: Dongjoon Hyun <dongjoon@apache.org>

Closes #17977 from dongjoon-hyun/SPARK-20735.

(cherry picked from commit bbd163d5)
Signed-off-by: default avatarXiao Li <gatorsmile@gmail.com>
parent 62969e9b
No related branches found
No related tags found
No related merge requests found
......@@ -43,6 +43,7 @@ object TPCDSQueryBenchmark {
.set("spark.driver.memory", "3g")
.set("spark.executor.memory", "3g")
.set("spark.sql.autoBroadcastJoinThreshold", (20 * 1024 * 1024).toString)
.set("spark.sql.crossJoin.enabled", "true")
val spark = SparkSession.builder.config(conf).getOrCreate()
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment