Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GpuSubstring handling to SortOrder canonicalization #1302

Merged
merged 2 commits into from
Dec 7, 2020

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Dec 7, 2020

Fixes #1269.

When canonicalizing a SortOrder to match the CPU, it turns out a GpuSubstring operation can be a child of a SortOrder. We weren't handling it, so it crashed. This adds canonicalization handling for GpuSubstring.

Verified this fixes the at-scale TPC-DS query 8 crash.

@jlowe jlowe added the SQL part of the SQL/Dataframe plugin label Dec 7, 2020
@jlowe jlowe added this to the Dec 7 - Dec 18 milestone Dec 7, 2020
@jlowe jlowe self-assigned this Dec 7, 2020
@jlowe
Copy link
Member Author

jlowe commented Dec 7, 2020

build

Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good we should have a follow on issue to verify to see what else I missed in my assumption that we would only get literals, AttributeReferences, normalization, and Metadata(GpuAlias, KnownFloatingPointNormalized)

@jlowe
Copy link
Member Author

jlowe commented Dec 7, 2020

we should have a follow on issue

I filed #1305 to track this.

@jlowe jlowe merged commit 4cb4f5b into NVIDIA:branch-0.3 Dec 7, 2020
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
@jlowe jlowe deleted the sort-order-substring branch September 10, 2021 15:31
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#1302)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
SQL part of the SQL/Dataframe plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] GpuSubstring is not expected to be a part of a SortOrder
3 participants