Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Handle hidden metadata columns #4426

Closed
jlowe opened this issue Dec 22, 2021 · 1 comment · Fixed by #4686
Closed

Handle hidden metadata columns #4426

jlowe opened this issue Dec 22, 2021 · 1 comment · Fixed by #4686
Assignees
@andygrove
Labels
audit_3.3.0 Audit related tasks for 3.3.0 P0 Must have for release task Work required that improves the product but is not user facing

Comments

@jlowe
Copy link
Member

jlowe commented Dec 22, 2021

SPARK-37273 added support for reading hidden metadata columns. We either need to support reading these columns or falling back to the CPU if these columns are requested.
@jlowe jlowe added ? - Needs Triage Need team to review and classify task Work required that improves the product but is not user facing audit_3.3.0 Audit related tasks for 3.3.0 labels Dec 22, 2021
@jlowe jlowe mentioned this issue Dec 22, 2021
Merged
@sameerz sameerz added P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Jan 4, 2022
@wbo4958 wbo4958 self-assigned this Jan 24, 2022
@wbo4958
Copy link
Collaborator

wbo4958 commented Jan 24, 2022

I will check this issue

@andygrove andygrove mentioned this issue Feb 7, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andygrove andygrove

Labels
audit_3.3.0 Audit related tasks for 3.3.0 P0 Must have for release task Work required that improves the product but is not user facing
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fall back to CPU for queries referencing hidden metadata columns andygrove/spark-rapids
4 participants
@andygrove @wbo4958 @jlowe @sameerz