Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix issues with cannonicalization of WrappedAggFunction #683

Merged
merged 1 commit into from
Sep 8, 2020

Conversation

revans2
Copy link
Collaborator

@revans2 revans2 commented Sep 8, 2020

This fixes #671

The magic in Spark around TreeNode does not work if the Expression or SparkPlan is an inner class. This just moved WrappedAggFunction from being an inner class to being a top level class and it fixed the bug.

I also cleaned up some doc warning for Canonicalization code that was copied and pasted from Spark.

Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
@revans2 revans2 added the bug Something isn't working label Sep 8, 2020
@revans2 revans2 added this to the Aug 31 - Sep 11 milestone Sep 8, 2020
@revans2 revans2 self-assigned this Sep 8, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Sep 8, 2020

build

Copy link
Collaborator

@kuhushukla kuhushukla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix, lgtm.

@revans2 revans2 merged commit edadbbd into NVIDIA:branch-0.2 Sep 8, 2020
@revans2 revans2 deleted the fix_canonicalize_more branch September 8, 2020 18:08
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#683)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Databricks hash_aggregate_test fails trying to canonicalize a WrappedAggFunction
3 participants