Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle ShuffleManager api calls when plugin is not fully initialized #1540

Merged
merged 3 commits into from
Jan 19, 2021

Conversation

abellina
Copy link
Collaborator

Signed-off-by: Alessandro Bellina abellina@nvidia.com

Fixes: #1513

Marking this as a draft as I need to run a couple of more tests.

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>
@jlowe jlowe added the shuffle things that impact the shuffle plugin label Jan 15, 2021
jlowe
jlowe previously approved these changes Jan 15, 2021
@abellina abellina marked this pull request as ready for review January 16, 2021 04:21
@abellina
Copy link
Collaborator Author

build

@jlowe
Copy link
Member

jlowe commented Jan 19, 2021

build

@abellina abellina merged commit 3f239f2 into NVIDIA:branch-0.4 Jan 19, 2021
@abellina abellina deleted the shuffle/handle_init_race branch January 19, 2021 21:34
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
…VIDIA#1540)

* Handle ShuffleManager api calls when plugin is not fully initialized

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>

* Address review comments

* Copyright - add 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
…VIDIA#1540)

* Handle ShuffleManager api calls when plugin is not fully initialized

Signed-off-by: Alessandro Bellina <abellina@nvidia.com>

* Address review comments

* Copyright - add 2021
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
…IDIA#1540)

Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
shuffle things that impact the shuffle plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] executor not fully initialized may get calls from Spark, in the process setting the catalog incorrectly
4 participants