Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

increase mem and limit parallelism for pre-merge #1694

Merged
merged 1 commit into from
Feb 9, 2021

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Feb 9, 2021

Signed-off-by: Peixin Li pxli@nyu.edu

Increase memory request to avoid potential OOM kill for pre-merge pod run during the parallel pytest run
And limit parallelism to make sure if we change GPU type w/ larger GPU mem, it won't be OOM in the pod unless we manually change both GPU and adjust host memory

Signed-off-by: Peixin Li <pxli@nyu.edu>
@pxLi pxLi added the build Related to CI / CD or cleanly building label Feb 9, 2021
@pxLi pxLi self-assigned this Feb 9, 2021
@pxLi pxLi requested a review from tgravescs as a code owner February 9, 2021 06:28
@pxLi
Copy link
Collaborator Author

pxLi commented Feb 9, 2021

build

Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like it only added a few mins to the build time, which is a lot better then crashing.

@revans2 revans2 merged commit a2afeda into NVIDIA:branch-0.4 Feb 9, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants