Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tell jitify_preprocess where to search for libnvrtc #11787

Conversation

robertmaynard
Copy link
Contributor

Description

On machines with multiple CUDA Toolkits installed it is possible to have a mismatch between the version of nvcc used to compile code and the version of libnvrtc used for the JIT code. This generally occurs when LD_LIBRARY_PATH points to a different version of the CUDA Toolkit.

We now explicitly specify what toolkit library directory to search when JIT code during libcudf compilation.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@robertmaynard robertmaynard added bug Something isn't working 3 - Ready for Review Ready for review by team non-breaking Non-breaking change labels Sep 27, 2022
@robertmaynard robertmaynard requested a review from a team as a code owner September 27, 2022 15:50
@github-actions github-actions bot added CMake CMake build issue libcudf Affects libcudf (C++/CUDA) code. labels Sep 27, 2022
@robertmaynard robertmaynard force-pushed the bug/ensure_jit_compilation_uses_nvrtc_from_same_cuda branch from ffeeddc to dfe1a24 Compare September 30, 2022 14:41
@codecov
Copy link

codecov bot commented Sep 30, 2022

Codecov Report

Base: 87.40% // Head: 87.52% // Increases project coverage by +0.11% 🎉

Coverage data is based on head (24932d7) compared to base (f72c4ce).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@               Coverage Diff                @@
##           branch-22.12   #11787      +/-   ##
================================================
+ Coverage         87.40%   87.52%   +0.11%     
================================================
  Files               133      133              
  Lines             21833    21807      -26     
================================================
+ Hits              19084    19087       +3     
+ Misses             2749     2720      -29     
Impacted Files Coverage Δ
python/cudf/cudf/core/udf/__init__.py 50.00% <ø> (ø)
python/cudf/cudf/utils/ioutils.py 79.47% <ø> (ø)
...thon/dask_cudf/dask_cudf/tests/test_distributed.py 18.86% <ø> (+4.94%) ⬆️
python/cudf/cudf/__init__.py 90.69% <100.00%> (ø)
python/cudf/cudf/core/scalar.py 90.52% <100.00%> (+1.25%) ⬆️
python/dask_cudf/dask_cudf/sorting.py 93.29% <100.00%> (+2.11%) ⬆️
python/strings_udf/strings_udf/__init__.py 96.87% <100.00%> (ø)
python/strings_udf/strings_udf/_typing.py 94.73% <0.00%> (-1.06%) ⬇️
python/cudf/cudf/testing/dataset_generator.py 72.83% <0.00%> (-0.42%) ⬇️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@robertmaynard
Copy link
Contributor Author

rerun tests

@robertmaynard robertmaynard force-pushed the bug/ensure_jit_compilation_uses_nvrtc_from_same_cuda branch from dfe1a24 to 91dfa83 Compare October 3, 2022 13:09
On machines with multiple CUDA Toolkits installed it is possible
to have a mismatch between the version of `nvcc` used to compile
code and the version of `libnvrtc` used for the JIT code. This
generally occurs when `LD_LIBRARY_PATH` points to a different
version of the CUDA Toolkit.

We now explicitly specify what toolkit library directory to search
when JIT code during libcudf compilation.
@robertmaynard robertmaynard force-pushed the bug/ensure_jit_compilation_uses_nvrtc_from_same_cuda branch from 91dfa83 to 24932d7 Compare October 3, 2022 19:31
@vyasr vyasr changed the base branch from branch-22.12 to branch-22.10 October 17, 2022 19:10
@vyasr vyasr changed the base branch from branch-22.10 to branch-22.12 October 17, 2022 19:10
@robertmaynard
Copy link
Contributor Author

@gpucibot merge

@rapids-bot rapids-bot bot merged commit 536ddd0 into rapidsai:branch-22.12 Oct 20, 2022
@robertmaynard robertmaynard deleted the bug/ensure_jit_compilation_uses_nvrtc_from_same_cuda branch October 20, 2022 16:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team bug Something isn't working CMake CMake build issue libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants