Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] GpuCheckOverflowInTableInsert should be added to databricks shim #9798

Closed
kuhushukla opened this issue Nov 20, 2023 · 0 comments · Fixed by #9800
Closed

[BUG] GpuCheckOverflowInTableInsert should be added to databricks shim #9798

kuhushukla opened this issue Nov 20, 2023 · 0 comments · Fixed by #9800
Assignees
@jlowe
Labels
bug Something isn't working

Comments

@kuhushukla
Copy link
Collaborator

Describe the bug
GpuCheckOverflowInTableInsert support should be extended to databricks shims.

Steps/Code to reproduce bug
Run a table write in DB environment where we try to put a long (for example) into an int column.

  ! <CheckOverflowInTableInsert> cast(tier2#13681 as int) cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.catalyst.expressions.CheckOverflowInTableInsert

Expected behavior
CheckOverflowInTableInsert should be relaced by GPU version on databricks

Environment details (please complete the following information)

  • Databricks 11.3
@kuhushukla kuhushukla added bug Something isn't working ? - Needs Triage Need team to review and classify labels Nov 20, 2023
@jlowe jlowe self-assigned this Nov 20, 2023
@jlowe jlowe mentioned this issue Nov 20, 2023
Merged
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jlowe jlowe

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add GpuCheckOverflowInTableInsert to Databricks 11.3+ jlowe/spark-rapids
3 participants
@jlowe @sameerz @kuhushukla