Skip to content

Commit

Permalink
[SPARK-38779][SQL][TESTS] Unify the pushed operator checking between …
Browse files Browse the repository at this point in the history
…FileSource test suite and JDBCV2Suite

### What changes were proposed in this pull request?
In `JDBCV2Suite`, we use `checkPushedInfo` to check the pushed down operators. Will do the same for `FileSourceAggregatePushDownSuite`
```
  private def checkPushedInfo(df: DataFrame, expectedPlanFragment: String): Unit = {
    df.queryExecution.optimizedPlan.collect {
      case _: DataSourceV2ScanRelation =>
        checkKeywordsExistsInExplain(df, expectedPlanFragment)
    }
  }
```

### Why are the changes needed?
Make `FileSourceAggregatePushDownSuite` have the same way to check pushed down operators as `JDBCV2Suite` .

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Existing tests

Closes apache#36050 from huaxingao/minor.

Authored-by: huaxingao <huaxin_gao@apple.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
  • Loading branch information
huaxingao authored and dongjoon-hyun committed Apr 4, 2022
1 parent 1b08673 commit 41a8249
Showing 1 changed file with 79 additions and 189 deletions.
Loading

0 comments on commit 41a8249

Please sign in to comment.