Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Audit] [FEA] [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions #4286

Closed
nartal1 opened this issue Dec 3, 2021 · 0 comments · Fixed by #4677
Closed

[Audit] [FEA] [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions #4286

nartal1 opened this issue Dec 3, 2021 · 0 comments · Fixed by #4677
Assignees
@nartal1
Labels
audit_3.3.0 Audit related tasks for 3.3.0 P1 Nice to have for release
Milestone
Jan 31 - Feb 11

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Dec 3, 2021

Is your feature request related to a problem? Please describe.
Collect, first and last are marked as deterministic in this PR:apache/spark@58e07e0f4c . We will have to update the code to reflect the same if we are not doing so.
@nartal1 nartal1 added feature request New feature or request ? - Needs Triage Need team to review and classify audit_3.3.0 Audit related tasks for 3.3.0 labels Dec 3, 2021
@nartal1 nartal1 changed the title [Audit] [FEA] [SPARK-32940][SQL] Collect, first and last should be deterministic a [Audit] [FEA] [SPARK-32940][SQL] Collect, first and last should be deterministic aggregate functions Dec 3, 2021
@Salonijain27 Salonijain27 added P1 Nice to have for release and removed ? - Needs Triage Need team to review and classify labels Dec 7, 2021
@nartal1 nartal1 self-assigned this Jan 31, 2022
@sameerz sameerz added this to the Jan 31 - Feb 11 milestone Feb 1, 2022
@nartal1 nartal1 mentioned this issue Feb 2, 2022
Merged
@sameerz sameerz removed the feature request New feature or request label Apr 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nartal1 nartal1

Labels
audit_3.3.0 Audit related tasks for 3.3.0 P1 Nice to have for release
Projects
None yet
Milestone
Jan 31 - Feb 11
Development

Successfully merging a pull request may close this issue.

Make Collect, first and last as deterministic aggregate functions for Spark-3.3 nartal1/spark-rapids
3 participants
@sameerz @Salonijain27 @nartal1