Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log total RMM allocated on GPU OOM #1054

Merged
merged 1 commit into from
Nov 2, 2020
Merged

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Nov 2, 2020

Logs the total allocated from RMM when a GPU OOM exception occurs to provide an indication of how much fragmentation is in the RMM pool when an allocation fails.

Fixes #1018

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
@jlowe jlowe added this to the Oct 26 - Nov 6 milestone Nov 2, 2020
@jlowe jlowe self-assigned this Nov 2, 2020
@jlowe
Copy link
Member Author

jlowe commented Nov 2, 2020

build

@jlowe jlowe merged commit 986e528 into NVIDIA:branch-0.3 Nov 2, 2020
@jlowe jlowe deleted the log-total-on-oom branch November 2, 2020 19:17
@sameerz sameerz added the feature request New feature or request label Nov 6, 2020
sperlingxx pushed a commit to sperlingxx/spark-rapids that referenced this pull request Nov 20, 2020
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] Log details related to GPU memory fragmentation on GPU OOM
3 participants