Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove unused async buffer spill support #503

Merged
merged 1 commit into from
Aug 3, 2020

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Aug 3, 2020

This removes the unused async spill support along with the associated configs that are not doing anything effective. There are plans to add a more robust multithreaded buffer spill support in the near future. After discussions with @revans2, we didn't see the need for additional complications caused by tracking a buffer that is both spilled and yet not freed in a buffer store. Removing the old, dead async code will leave a cleaner slate for the upcoming multithreaded spill.

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe added the shuffle things that impact the shuffle plugin label Aug 3, 2020
@jlowe jlowe added this to the Aug 3 - Aug 14 milestone Aug 3, 2020
@jlowe jlowe self-assigned this Aug 3, 2020
@jlowe
Copy link
Member Author

jlowe commented Aug 3, 2020

build

@jlowe jlowe merged commit 8834e1a into NVIDIA:branch-0.2 Aug 3, 2020
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe deleted the rm-async-spill branch September 10, 2021 15:31
pxLi pushed a commit to pxLi/spark-rapids that referenced this pull request May 12, 2022
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
shuffle things that impact the shuffle plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants