Data inspect #521
Data inspect #521
Conversation
Click to view CI ResultsGitHub pull request #521 of commit 3e29ef32bd211f40bca067ded04651caa09409ef, no merge conflicts.
Running as SYSTEM
Setting status of 3e29ef32bd211f40bca067ded04651caa09409ef to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1449/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 3e29ef32bd211f40bca067ded04651caa09409ef^{commit} # timeout=10
Checking out Revision 3e29ef32bd211f40bca067ded04651caa09409ef (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3e29ef32bd211f40bca067ded04651caa09409ef # timeout=10
Commit message: "Adds unit test"
> git rev-list --no-walk bc6dc7c51f0acd5514888b6be647907efde89d10 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3274625358681975311.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
81 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 537 items
|
Click to view CI ResultsGitHub pull request #521 of commit a3c8722eeb1eac7202aff3170c4f218da3426b51, no merge conflicts.
Running as SYSTEM
Setting status of a3c8722eeb1eac7202aff3170c4f218da3426b51 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1468/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse a3c8722eeb1eac7202aff3170c4f218da3426b51^{commit} # timeout=10
Checking out Revision a3c8722eeb1eac7202aff3170c4f218da3426b51 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f a3c8722eeb1eac7202aff3170c4f218da3426b51 # timeout=10
Commit message: "Updates json output and multihot calculation"
> git rev-list --no-walk ad83c7ae8a5d34adf9d21127946f98ae40795364 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins8836009779784977150.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+15.ga3c8722
Uninstalling nvtabular-0.3.0+15.ga3c8722:
Successfully uninstalled nvtabular-0.3.0+15.ga3c8722
Running setup.py develop for nvtabular
Successfully installed nvtabular
error: cannot format /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/tools/dataset_inspector.py: Cannot parse: 69:16: if ddf[col].dtype.leaf_type == "string":
Oh no! 💥 💔 💥
80 files would be left unchanged, 1 file would fail to reformat.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins8797665715078067190.sh
|
Click to view CI ResultsGitHub pull request #521 of commit 2a52415d4f25ba13d8405b1e5496a0751958eb7b, no merge conflicts.
Running as SYSTEM
Setting status of 2a52415d4f25ba13d8405b1e5496a0751958eb7b to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1470/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 2a52415d4f25ba13d8405b1e5496a0751958eb7b^{commit} # timeout=10
Checking out Revision 2a52415d4f25ba13d8405b1e5496a0751958eb7b (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2a52415d4f25ba13d8405b1e5496a0751958eb7b # timeout=10
Commit message: "Updates list processing"
> git rev-list --no-walk fcfd38534871827d001d98c9db23af626749e375 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5268918968425135953.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+16.g2a52415
Uninstalling nvtabular-0.3.0+16.g2a52415:
Successfully uninstalled nvtabular-0.3.0+16.g2a52415
Running setup.py develop for nvtabular
Successfully installed nvtabular
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/tools/dataset_inspector.py
Oh no! 💥 💔 💥
1 file would be reformatted, 80 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins3675556177946569106.sh
|
Click to view CI ResultsGitHub pull request #521 of commit e9b87734ff56c66d4fee7f1060b1d9af7764167f, no merge conflicts.
Running as SYSTEM
Setting status of e9b87734ff56c66d4fee7f1060b1d9af7764167f to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1471/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse e9b87734ff56c66d4fee7f1060b1d9af7764167f^{commit} # timeout=10
Checking out Revision e9b87734ff56c66d4fee7f1060b1d9af7764167f (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e9b87734ff56c66d4fee7f1060b1d9af7764167f # timeout=10
Commit message: "Updates test"
> git rev-list --no-walk 2a52415d4f25ba13d8405b1e5496a0751958eb7b # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins4430635498173288458.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+17.ge9b8773
Uninstalling nvtabular-0.3.0+17.ge9b8773:
Successfully uninstalled nvtabular-0.3.0+17.ge9b8773
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
81 files would be left unchanged.
./nvtabular/tools/dataset_inspector.py:19:1: F401 'cudf' imported but unused
./nvtabular/tools/__init__.py:16:1: F401 '.dataset_inspector.DatasetInspector' imported but unused
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins8051002341542512124.sh
|
Click to view CI ResultsGitHub pull request #521 of commit 199e818570a49d20c1f23132e2299aa595b16d2b, no merge conflicts.
Running as SYSTEM
Setting status of 199e818570a49d20c1f23132e2299aa595b16d2b to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1483/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 199e818570a49d20c1f23132e2299aa595b16d2b^{commit} # timeout=10
Checking out Revision 199e818570a49d20c1f23132e2299aa595b16d2b (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 199e818570a49d20c1f23132e2299aa595b16d2b # timeout=10
Commit message: "Adds cudf issue"
> git rev-list --no-walk 7ea69ebc5bb4c9e588af5f0f37675b0a5f80ba72 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3691191528921297468.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g199e818
Uninstalling nvtabular-0.3.0+18.g199e818:
Successfully uninstalled nvtabular-0.3.0+18.g199e818
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
81 files would be left unchanged.
./nvtabular/tools/dataset_inspector.py:88:101: E501 line too long (103 > 100 characters)
./nvtabular/tools/dataset_inspector.py:89:101: E501 line too long (107 > 100 characters)
./nvtabular/tools/__init__.py:16:1: F401 '.dataset_inspector.DatasetInspector' imported but unused
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5340054830216335842.sh
|
Click to view CI ResultsGitHub pull request #521 of commit e3a807a231113f9d5b371b808c49f6f1bd80e98b, no merge conflicts.
Running as SYSTEM
Setting status of e3a807a231113f9d5b371b808c49f6f1bd80e98b to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1485/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse e3a807a231113f9d5b371b808c49f6f1bd80e98b^{commit} # timeout=10
Checking out Revision e3a807a231113f9d5b371b808c49f6f1bd80e98b (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f e3a807a231113f9d5b371b808c49f6f1bd80e98b # timeout=10
Commit message: "Data inspector ready"
> git rev-list --no-walk b08f8781935a592601320e5beedec1ced0a1e113 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins7470636000492385073.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
Click to view CI ResultsGitHub pull request #521 of commit 6bee99fcdb5d675c2c56ff59825fe34f8c2f1350, no merge conflicts.
Running as SYSTEM
Setting status of 6bee99fcdb5d675c2c56ff59825fe34f8c2f1350 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1486/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 6bee99fcdb5d675c2c56ff59825fe34f8c2f1350^{commit} # timeout=10
Checking out Revision 6bee99fcdb5d675c2c56ff59825fe34f8c2f1350 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6bee99fcdb5d675c2c56ff59825fe34f8c2f1350 # timeout=10
Commit message: "Test works"
> git rev-list --no-walk e3a807a231113f9d5b371b808c49f6f1bd80e98b # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2320933489149017601.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+23.g6bee99f
Uninstalling nvtabular-0.3.0+23.g6bee99f:
Successfully uninstalled nvtabular-0.3.0+23.g6bee99f
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 557 items / 1 error / 556 selected
|
Click to view CI ResultsGitHub pull request #521 of commit d8a564333a67bb474d767f4d9d9baff212014e33, no merge conflicts.
Running as SYSTEM
Setting status of d8a564333a67bb474d767f4d9d9baff212014e33 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1488/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse d8a564333a67bb474d767f4d9d9baff212014e33^{commit} # timeout=10
Checking out Revision d8a564333a67bb474d767f4d9d9baff212014e33 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f d8a564333a67bb474d767f4d9d9baff212014e33 # timeout=10
Commit message: "Dataset inspect read - Tests passing"
> git rev-list --no-walk c0ae28de1e60c4fd14e4dc4e04e83775db55b7f5 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins6307068742077306661.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+24.gd8a5643
Uninstalling nvtabular-0.3.0+24.gd8a5643:
Successfully uninstalled nvtabular-0.3.0+24.gd8a5643
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
There was a problem hiding this comment.
Remove all of those examples/dataset_inspector assets. put the inspector example as a comment within the command line tool when you move it into the code base. This will allow the docs to pick that up and turn it into an example within the documentation that users can reference.
| @@ -0,0 +1,73 @@ | |||
| # | |||
There was a problem hiding this comment.
This file is actually the command line tool for the dataset Inspector class... It's not really an example. We should move this into the code base. We wont be able to actually have examples of this... In this format. It will have to be more like a readme type with examples on how to use. We wont actually have notebooks.
Click to view CI ResultsGitHub pull request #521 of commit caa312cd357e2d53925db9cd53d9b2420b551221, no merge conflicts.
Running as SYSTEM
Setting status of caa312cd357e2d53925db9cd53d9b2420b551221 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1489/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse caa312cd357e2d53925db9cd53d9b2420b551221^{commit} # timeout=10
Checking out Revision caa312cd357e2d53925db9cd53d9b2420b551221 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f caa312cd357e2d53925db9cd53d9b2420b551221 # timeout=10
Commit message: "Moves dataset inspector script"
> git rev-list --no-walk d8a564333a67bb474d767f4d9d9baff212014e33 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7688479711240999931.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+25.gcaa312c
Uninstalling nvtabular-0.3.0+25.gcaa312c:
Successfully uninstalled nvtabular-0.3.0+25.gcaa312c
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit caa312cd357e2d53925db9cd53d9b2420b551221, no merge conflicts.
Running as SYSTEM
Setting status of caa312cd357e2d53925db9cd53d9b2420b551221 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1490/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse caa312cd357e2d53925db9cd53d9b2420b551221^{commit} # timeout=10
Checking out Revision caa312cd357e2d53925db9cd53d9b2420b551221 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f caa312cd357e2d53925db9cd53d9b2420b551221 # timeout=10
Commit message: "Moves dataset inspector script"
> git rev-list --no-walk caa312cd357e2d53925db9cd53d9b2420b551221 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7652535698069483529.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+25.gcaa312c
Uninstalling nvtabular-0.3.0+25.gcaa312c:
Successfully uninstalled nvtabular-0.3.0+25.gcaa312c
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
Click to view CI ResultsGitHub pull request #521 of commit 1d2fb521abb4f3ad9fcff980eefbf3349626a53f, no merge conflicts.
Running as SYSTEM
Setting status of 1d2fb521abb4f3ad9fcff980eefbf3349626a53f to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1491/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 1d2fb521abb4f3ad9fcff980eefbf3349626a53f^{commit} # timeout=10
Checking out Revision 1d2fb521abb4f3ad9fcff980eefbf3349626a53f (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1d2fb521abb4f3ad9fcff980eefbf3349626a53f # timeout=10
Commit message: "Initial inspect-datagent test"
> git rev-list --no-walk caa312cd357e2d53925db9cd53d9b2420b551221 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7399859435030933647.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
83 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 560 items
|
Click to view CI ResultsGitHub pull request #521 of commit 8111e3e78efb2dcb5094177d720729acb68582fb, no merge conflicts.
Running as SYSTEM
Setting status of 8111e3e78efb2dcb5094177d720729acb68582fb to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1497/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 8111e3e78efb2dcb5094177d720729acb68582fb^{commit} # timeout=10
Checking out Revision 8111e3e78efb2dcb5094177d720729acb68582fb (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
Commit message: "Data gen and data inspect work together"
> git rev-list --no-walk b55bef79bd496a2cf7505d302b5b48a7f4dc8da6 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins1032848889484682575.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+16.g779b544
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins4371275478190635855.sh
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit 8111e3e78efb2dcb5094177d720729acb68582fb, no merge conflicts.
Running as SYSTEM
Setting status of 8111e3e78efb2dcb5094177d720729acb68582fb to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1498/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 8111e3e78efb2dcb5094177d720729acb68582fb^{commit} # timeout=10
Checking out Revision 8111e3e78efb2dcb5094177d720729acb68582fb (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
Commit message: "Data gen and data inspect work together"
> git rev-list --no-walk 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7317973124949593702.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+16.g779b544
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins6246142106023035049.sh
|
|
rerun tests |
1 similar comment
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit 8111e3e78efb2dcb5094177d720729acb68582fb, no merge conflicts.
Running as SYSTEM
Setting status of 8111e3e78efb2dcb5094177d720729acb68582fb to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1499/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 8111e3e78efb2dcb5094177d720729acb68582fb^{commit} # timeout=10
Checking out Revision 8111e3e78efb2dcb5094177d720729acb68582fb (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
Commit message: "Data gen and data inspect work together"
> git rev-list --no-walk 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins2916650104798956803.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+16.g779b544
Can't uninstall 'nvtabular'. No files were found to uninstall.
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
83 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
Click to view CI ResultsGitHub pull request #521 of commit 8111e3e78efb2dcb5094177d720729acb68582fb, no merge conflicts.
Running as SYSTEM
Setting status of 8111e3e78efb2dcb5094177d720729acb68582fb to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1500/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 8111e3e78efb2dcb5094177d720729acb68582fb^{commit} # timeout=10
Checking out Revision 8111e3e78efb2dcb5094177d720729acb68582fb (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
Commit message: "Data gen and data inspect work together"
> git rev-list --no-walk 8111e3e78efb2dcb5094177d720729acb68582fb # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins8781814357731727211.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+28.g8111e3e
Uninstalling nvtabular-0.3.0+28.g8111e3e:
Successfully uninstalled nvtabular-0.3.0+28.g8111e3e
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
83 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
tests/unit/test_tools.py
Outdated
| cluster = LocalCUDACluster() | ||
| client = Client(cluster) |
There was a problem hiding this comment.
We have test fixtures for these - can you use that instead? https://github.com/NVIDIA/NVTabular/blob/7a8fdd7f584f3c7ca3a0acf6b61c4493e3438255/tests/conftest.py#L63-L67
The danger here is that if you throw an exception in this method the cluster won't get shutdown, causing problems in other tests.
nvtabular/tools/dataset_inspector.py
Outdated
| Dask dataframe with the data | ||
| ddf : dask.dataframe.DataFrame | ||
| Dask dataframe with the correct dtypes | ||
| col: string |
There was a problem hiding this comment.
Can we use the numpy docstring guide here for https://numpydoc.readthedocs.io/en/latest/format.html#method-docstrings (see parameters).
| col: string | |
| col: str |
There was a problem hiding this comment.
Sorry about that, I will use the guide.
nvtabular/tools/dataset_inspector.py
Outdated
| Dask dataframe with the correct dtypes | ||
| col: string | ||
| Col to process | ||
| data: Dictionary |
There was a problem hiding this comment.
| data: Dictionary | |
| data: dict | |
nvtabular/tools/dataset_inspector.py
Outdated
| Col to process | ||
| data: Dictionary | ||
| Dictionary to store the output stats | ||
| col_type: tring |
There was a problem hiding this comment.
| col_type: tring | |
| col_type: str | |
nvtabular/tools/dataset_inspector.py
Outdated
| Dictionary to store the output stats | ||
| col_type: tring | ||
| Column type (i.e cat, cont, label) | ||
| key_names: Dictionary |
There was a problem hiding this comment.
| key_names: Dictionary | |
| key_names: dict | |
| """ | ||
| Parameters | ||
| ----------- | ||
| path: str, list of str, or <dask.dataframe|cudf|pd>.DataFrame |
There was a problem hiding this comment.
Why not use a nvtabular.Dataset object here? That wraps all the functionality you need (takes dask dataframe/path/cudf dataframe/ pandas dataframe)
There was a problem hiding this comment.
Dataset is the nvtabular.io.Dataset i think based on imports.
There was a problem hiding this comment.
The paths get turned into a nvt dataset. We ask for the paths so that the class can be used from command line to generate a json file.
There was a problem hiding this comment.
We are using the Dataset object here: dataset = Dataset(path, engine=dataset_format).
There was a problem hiding this comment.
Whats the advantage here to taking a path/format and then immediately converting to a Dataset? Can' we just pass the dataset object in directly?
nvtabular/tools/dataset_inspector.py
Outdated
|
|
||
| # Stop Dask Cluster | ||
| client.shutdown() | ||
| cluster.close() |
There was a problem hiding this comment.
we should use a context manager for this - to make sure we get shutdown/close on exceptions
Click to view CI ResultsGitHub pull request #521 of commit 78b7571f39b0cbf8b1ec6aa47b3c66181a9a436c, no merge conflicts.
Running as SYSTEM
Setting status of 78b7571f39b0cbf8b1ec6aa47b3c66181a9a436c to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1504/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 78b7571f39b0cbf8b1ec6aa47b3c66181a9a436c^{commit} # timeout=10
Checking out Revision 78b7571f39b0cbf8b1ec6aa47b3c66181a9a436c (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 78b7571f39b0cbf8b1ec6aa47b3c66181a9a436c # timeout=10
Commit message: "Initial Stats computation as an operator"
> git rev-list --no-walk c6c8faadcadae36f680cf2efd6cec8bf042fd483 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2072347295624927623.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+29.g78b7571
Uninstalling nvtabular-0.3.0+29.g78b7571:
Successfully uninstalled nvtabular-0.3.0+29.g78b7571
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
./tests/unit/test_tools.py:12:1: F401 'nvtabular.io.Dataset' imported but unused
./tests/unit/test_tools.py:13:1: F401 'tests.conftest.client' imported but unused
./nvtabular/tools/dataset_inspector.py:17:1: F401 'contextlib.contextmanager' imported but unused
./nvtabular/tools/dataset_inspector.py:19:1: F401 'cudf' imported but unused
./nvtabular/tools/dataset_inspector.py:23:1: F401 'dask_cuda.LocalCUDACluster' imported but unused
./nvtabular/tools/dataset_inspector.py:32:21: F821 undefined name 'LocalCluster'
./nvtabular/tools/dataset_inspector.py:74:9: F841 local variable 'cats' is assigned to but never used
./nvtabular/tools/dataset_inspector.py:75:9: F841 local variable 'conts' is assigned to but never used
./nvtabular/tools/dataset_inspector.py:76:9: F841 local variable 'labels' is assigned to but never used
./nvtabular/tools/dataset_inspector.py:92:20: F821 undefined name 'all_cols'
./nvtabular/tools/dataset_inspector.py:102:24: F821 undefined name 'all_cols'
./nvtabular/ops/data_stats.py:28:6: F821 undefined name 'annotate'
./nvtabular/ops/data_stats.py:29:28: F821 undefined name 'ColumnNames'
./nvtabular/ops/data_stats.py:41:20: F821 undefined name 'ddf_dtypes'
./nvtabular/ops/data_stats.py:69:13: F841 local variable 'mean_val' is assigned to but never used
./nvtabular/ops/data_stats.py:99:13: F821 undefined name 'output'
./nvtabular/ops/data_stats.py:107:5: F821 undefined name 'transform'
./nvtabular/ops/data_stats.py:107:25: F821 undefined name 'Operator'
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5151767239707400864.sh
|
Click to view CI ResultsGitHub pull request #521 of commit 510e821db2a5b68be7c21092b54bf90f45d2b26a, no merge conflicts.
Running as SYSTEM
Setting status of 510e821db2a5b68be7c21092b54bf90f45d2b26a to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1512/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 510e821db2a5b68be7c21092b54bf90f45d2b26a^{commit} # timeout=10
Checking out Revision 510e821db2a5b68be7c21092b54bf90f45d2b26a (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 510e821db2a5b68be7c21092b54bf90f45d2b26a # timeout=10
Commit message: "Improves but still error"
> git rev-list --no-walk e45c08fa4242ed7f390441f915b804e578d947b6 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins7264767334017863537.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+30.g510e821
Uninstalling nvtabular-0.3.0+30.g510e821:
Successfully uninstalled nvtabular-0.3.0+30.g510e821
Running setup.py develop for nvtabular
Successfully installed nvtabular
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/ops/data_stats.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/tools/dataset_inspector.py
Oh no! 💥 💔 💥
2 files would be reformatted, 82 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins4447000565955154219.sh
|
Click to view CI ResultsGitHub pull request #521 of commit 827f7c42e7110062a24e124257c485bb219ec494, no merge conflicts.
Running as SYSTEM
Setting status of 827f7c42e7110062a24e124257c485bb219ec494 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1513/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 827f7c42e7110062a24e124257c485bb219ec494^{commit} # timeout=10
Checking out Revision 827f7c42e7110062a24e124257c485bb219ec494 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 827f7c42e7110062a24e124257c485bb219ec494 # timeout=10
Commit message: "Removes list support to simplify"
> git rev-list --no-walk 510e821db2a5b68be7c21092b54bf90f45d2b26a # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins6520956366340217961.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+31.g827f7c4
Uninstalling nvtabular-0.3.0+31.g827f7c4:
Successfully uninstalled nvtabular-0.3.0+31.g827f7c4
Running setup.py develop for nvtabular
Successfully installed nvtabular
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/ops/data_stats.py
would reformat /var/jenkins_home/workspace/nvtabular_tests/nvtabular/nvtabular/tools/dataset_inspector.py
Oh no! 💥 💔 💥
2 files would be reformatted, 82 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins1967979468793437349.sh
|
Click to view CI ResultsGitHub pull request #521 of commit 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188, no merge conflicts.
Running as SYSTEM
Setting status of 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1518/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188^{commit} # timeout=10
Checking out Revision 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 # timeout=10
Commit message: "Tests inspect-datagen working"
> git rev-list --no-walk d8eb85c4d049d9e07509cd1da7c0515dddf73027 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins6924596389324111943.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g10ee22c
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins6785374982083974648.sh
|
|
@benfred I applied all the changes. @jperez999 It looks like CI is broken. |
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188, no merge conflicts.
Running as SYSTEM
Setting status of 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1519/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188^{commit} # timeout=10
Checking out Revision 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 # timeout=10
Commit message: "Tests inspect-datagen working"
> git rev-list --no-walk 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins4792261139226930572.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g10ee22c
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins7461381200271302484.sh
|
| """ | ||
| Parameters | ||
| ----------- | ||
| path: str, list of str, or <dask.dataframe|cudf|pd>.DataFrame |
There was a problem hiding this comment.
Whats the advantage here to taking a path/format and then immediately converting to a Dataset? Can' we just pass the dataset object in directly?
nvtabular/tools/dataset_inspector.py
Outdated
| if col_type != "labels": | ||
| data[col_type][col][key_names["min"][col_type]] = output[col]["min"] | ||
| data[col_type][col][key_names["max"][col_type]] = output[col]["max"] | ||
| data[col_type][col][key_names["mean"][col_type]] = output[col]["mean"] | ||
| if col_type == "conts": |
There was a problem hiding this comment.
Nitpick: the key_names structure is confusing - and removing it in favour of an if/elif will reduce the number of lines slightly:
| if col_type != "labels": | |
| data[col_type][col][key_names["min"][col_type]] = output[col]["min"] | |
| data[col_type][col][key_names["max"][col_type]] = output[col]["max"] | |
| data[col_type][col][key_names["mean"][col_type]] = output[col]["mean"] | |
| if col_type == "conts": | |
| if col_type == "cats": | |
| data[col_type][col]["min_entry_size"] = output[col]["min"] | |
| data[col_type][col]["max_entry_size"] = output[col]["max"] | |
| data[col_type][col]["avg_entry_size"] = output[col]["mean"] | |
| elif col_type == "conts": | |
| data[col_type][col]["min_val"] = output[col]["min"] | |
| data[col_type][col]["max_val"] = output[col]["max"] | |
| data[col_type][col]["mean"] = output[col]["mean"] |
nvtabular/ops/data_stats.py
Outdated
| if np.issubdtype(dtype, np.float): | ||
| col_type = "cont" | ||
| else: | ||
| col_type = "cat" |
There was a problem hiding this comment.
Can we assume that all integers are categorical columns? What if the column is an integer representing something like the users age?
Also - do we need a cat/col/label breakdown at all here? Can we just calculate different statistics based off the dtype of the column?
Click to view CI ResultsGitHub pull request #521 of commit 71db921df009b9765d69e4d10f0070eb8b99c3b8, no merge conflicts.
Running as SYSTEM
Setting status of 71db921df009b9765d69e4d10f0070eb8b99c3b8 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1520/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 71db921df009b9765d69e4d10f0070eb8b99c3b8^{commit} # timeout=10
Checking out Revision 71db921df009b9765d69e4d10f0070eb8b99c3b8 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 71db921df009b9765d69e4d10f0070eb8b99c3b8 # timeout=10
Commit message: "Reestructures script and fixes review"
> git rev-list --no-walk 99e1d9c8825a7cc0dcbcebc5fc34dfcd5d814188 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins8083792694137722375.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g10ee22c
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins4579420982097147350.sh
|
Click to view CI ResultsGitHub pull request #521 of commit f71fd9d8d9f39ca9e4125f85eda14784a30bcd09, no merge conflicts.
Running as SYSTEM
Setting status of f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1521/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse f71fd9d8d9f39ca9e4125f85eda14784a30bcd09^{commit} # timeout=10
Checking out Revision f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
Commit message: "All working"
> git rev-list --no-walk 71db921df009b9765d69e4d10f0070eb8b99c3b8 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins3160668179631641617.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g10ee22c
ERROR: Exception:
Traceback (most recent call last):
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 228, in _main
status = self.run(options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/cli/req_command.py", line 182, in wrapper
return func(self, options, args)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 406, in run
pycompile=options.compile,
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/__init__.py", line 76, in install_given_reqs
auto_confirm=True
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 685, in uninstall
uninstalled_pathset = UninstallPathSet.from_dist(dist)
File "/opt/conda/envs/rapids/lib/python3.7/site-packages/pip/_internal/req/req_uninstall.py", line 545, in from_dist
link_pointer, dist.project_name, dist.location)
AssertionError: Egg-link /var/jenkins_home/workspace/nvtab_integration/nvtabular does not match installed location of nvtabular (at /var/jenkins_home/workspace/nvtab_docs/nvtabular)
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
source activate rapids
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins3355861542452888696.sh
|
|
@benfred Changes applied. I have added more configuration options for the Dask cluster, and I got that part out of the inspector to the script. I think it makes more sense to just pass a client to the Inspector rather than dealing inside wit this. |
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit f71fd9d8d9f39ca9e4125f85eda14784a30bcd09, no merge conflicts.
Running as SYSTEM
Setting status of f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1522/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse f71fd9d8d9f39ca9e4125f85eda14784a30bcd09^{commit} # timeout=10
Checking out Revision f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
Commit message: "All working"
> git rev-list --no-walk f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7532762471586864464.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+18.g10ee22c
Can't uninstall 'nvtabular'. No files were found to uninstall.
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
|
rerun tests |
Click to view CI ResultsGitHub pull request #521 of commit f71fd9d8d9f39ca9e4125f85eda14784a30bcd09, no merge conflicts.
Running as SYSTEM
Setting status of f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1523/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse f71fd9d8d9f39ca9e4125f85eda14784a30bcd09^{commit} # timeout=10
Checking out Revision f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
Commit message: "All working"
> git rev-list --no-walk f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins8861694820751636797.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+39.gf71fd9d
Uninstalling nvtabular-0.3.0+39.gf71fd9d:
Successfully uninstalled nvtabular-0.3.0+39.gf71fd9d
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
Click to view CI ResultsGitHub pull request #521 of commit 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466, no merge conflicts.
Running as SYSTEM
Setting status of 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1524/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466^{commit} # timeout=10
Checking out Revision 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466 # timeout=10
Commit message: "Increases error tolerance"
> git rev-list --no-walk f71fd9d8d9f39ca9e4125f85eda14784a30bcd09 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins7319059244865873169.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
Click to view CI ResultsGitHub pull request #521 of commit 635376ececa34948c08dc6c133e33bc3c5d097ee, no merge conflicts.
Running as SYSTEM
Setting status of 635376ececa34948c08dc6c133e33bc3c5d097ee to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/1525/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential ghub_token
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials github token setup
> git fetch --tags --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/521/*:refs/remotes/origin/pr/521/* # timeout=10
> git rev-parse 635376ececa34948c08dc6c133e33bc3c5d097ee^{commit} # timeout=10
Checking out Revision 635376ececa34948c08dc6c133e33bc3c5d097ee (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 635376ececa34948c08dc6c133e33bc3c5d097ee # timeout=10
Commit message: "All Working"
> git rev-list --no-walk 1d4b4e16944707581c3a3ab0fac91b1c0f0ce466 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins3994755179524787056.sh
Obtaining file:///var/jenkins_home/workspace/nvtabular_tests/nvtabular
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing wheel metadata: started
Preparing wheel metadata: finished with status 'done'
Installing collected packages: nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 0.3.0+39.g635376e
Uninstalling nvtabular-0.3.0+39.g635376e:
Successfully uninstalled nvtabular-0.3.0+39.g635376e
Running setup.py develop for nvtabular
Successfully installed nvtabular
All done! ✨ 🍰 ✨
84 files would be left unchanged.
/opt/conda/envs/rapids/lib/python3.7/site-packages/isort/files.py:30: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 1 files
============================= test session starts ==============================
platform linux -- Python 3.7.8, pytest-6.1.1, py-1.9.0, pluggy-0.13.1
benchmark: 3.2.3 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /var/jenkins_home/workspace/nvtabular_tests/nvtabular, configfile: setup.cfg
plugins: benchmark-3.2.3, asyncio-0.12.0, hypothesis-5.37.4, timeout-1.4.2, cov-2.10.1, forked-1.3.0, xdist-2.2.0
collected 559 items
|
It looks like some files got commited recently (in NVIDIA-Merlin#521) with windows style linefeed/carriage returns instead of just the linefeed in the rest of the codebase. Fix so we don't generate massive whitespace diffs on every commit.
It looks like some files got commited recently (in #521) with windows style linefeed/carriage returns instead of just the linefeed in the rest of the codebase. Fix so we don't generate massive whitespace diffs on every commit.
* Initial commit in new branch * Adds unit test * Updates json output and multihot calculation * Updates list processing * Updates test * Adds cudf issue * Data inspector ready * Test works * Dataset inspect read - Tests passing * Moves dataset inspector script * Initial inspect-datagent test * Data gen and data inspect work together * Initial Stats computation as an operator * Improves but still error * Removes list support to simplify * Different Series type for computations * Cleans and use attributes * Data Stats Operator working * Tests inspect-datagen working * Reestructures script and fixes review * All Working
It looks like some files got commited recently (in #521) with windows style linefeed/carriage returns instead of just the linefeed in the rest of the codebase. Fix so we don't generate massive whitespace diffs on every commit.
Opening because #510 was closed after new_api branch was merged into main.
@jperez999 I applied the feedback you told me, and I also added unit test. I have seen your data generation branch, I can follow your packaging style when you get that PR Merged.
Pending for the future: