Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add pytest tags for nightly test parallel run [skip ci] #4373

Merged
merged 3 commits into from
Dec 17, 2021

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Dec 16, 2021

Signed-off-by: Peixin Li pxli@nyu.edu

fix #4348.

added 3 new pytest tags to better differentiate tests/cases used in spark-tests.sh script

Signed-off-by: Peixin Li <pxli@nyu.edu>
@pxLi pxLi added the test Only impacts tests label Dec 16, 2021
@pxLi
Copy link
Collaborator Author

pxLi commented Dec 16, 2021

build

@@ -26,5 +26,8 @@ markers =
validate_execs_in_gpu_plan([execs]): Exec class names to validate they exist in the GPU plan.
shuffle_test: Mark to include test in the RAPIDS Shuffle Manager
premerge_ci_1: Mark test that will run in first k8s pod in case of parallel build premerge job
nightly_test_to_cases: tests either time-consuming or mem-consuming, we split them into cases in nightly
Copy link
Collaborator

@tgravescs tgravescs Dec 16, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure I understand what the to_cases description here? does this mark entire file and then if you want just a single test you use the nightly_*case ones? if I saw this I would not think of time consuming or mem consuming so I think we should rename.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nightly_test_to_cases this mark the entire test file (most of cases are time consuming) which will be split into cases in parallel run

So we parallel

  1. special cases in nightly_test_to_cases
  2. nightly_test_to_cases
  3. other tests files

let me try rename this to something meaningful

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tgravescs renamed to nightly_resource_consuming_test, please let me know if this sounds OK, thx~

@pxLi
Copy link
Collaborator Author

pxLi commented Dec 17, 2021

build

@pxLi
Copy link
Collaborator Author

pxLi commented Dec 17, 2021

build

@pxLi
Copy link
Collaborator Author

pxLi commented Dec 17, 2021

Going to merge and trigger internal build

@pxLi pxLi merged commit 957b147 into NVIDIA:branch-22.02 Dec 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] tagging for nightly test categories
2 participants