Skip to content

Commit

Permalink
[SPARK-39856][SQL][TESTS][FOLLOW-UP] Increase the number of partition…
Browse files Browse the repository at this point in the history
…s in TPC-DS build to avoid out-of-memory

### What changes were proposed in this pull request?

This PR increases the number of partitions further more (see also #37270)

### Why are the changes needed?

To make the build pass.

### Does this PR introduce _any_ user-facing change?
No, test and dev-only.

### How was this patch tested?

It's tested in https://github.com/LuciferYang/spark/runs/7497163716?check_suite_focus=true

Closes #37273 from LuciferYang/SPARK-39856-FOLLOWUP.

Authored-by: yangjie01 <yangjie01@baidu.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
  • Loading branch information
LuciferYang authored and HyukjinKwon committed Jul 25, 2022
1 parent 5dca26d commit ae1f6a2
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ class TPCDSQueryTestSuite extends QueryTest with TPCDSBase with SQLQueryTestHelp

// To make output results deterministic
override protected def sparkConf: SparkConf = super.sparkConf
.set(SQLConf.SHUFFLE_PARTITIONS.key, 4.toString)
.set(SQLConf.SHUFFLE_PARTITIONS.key, 16.toString)

protected override def createSparkSession: TestSparkSession = {
new TestSparkSession(new SparkContext("local[1]", this.getClass.getSimpleName, sparkConf))
Expand Down

0 comments on commit ae1f6a2

Please sign in to comment.