You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, RAPIDS projects build wheels with build isolation, like pip wheel ..
With build isolation, the build tool (in our case, pip wheel), creates a virtual environment and installs of the package's build-time dependencies into it. That virtual environment is created at a random location on each build, which means source files included from other wheels (like the rmm headers from the librmm wheel) are found at a different path on each build in CI.
Path changes lead to cache misses with sccache, and therefore longer-running and more memory-intensive builds.
As more of RAPIDS build-time dependencies are provided wheels (e.g. #33), this problem is going to get worse (see #33 (comment)).
This issue tracks the work of removing build isolation in RAPIDS wheel-building CI jobs.
Benefits of this work
Better sccache hit rate = faster, cheaper CI (contributes to #95).
Stronger guarantees that packages built in CI are actually installed at test time (i.e. would close #79).
Acceptance Criteria
all RAPIDS wheels builds in CI build with --no-build-isolation
Description
Currently, RAPIDS projects build wheels with build isolation, like
pip wheel .
.With build isolation, the build tool (in our case,
pip wheel
), creates a virtual environment and installs of the package's build-time dependencies into it. That virtual environment is created at a random location on each build, which means source files included from other wheels (like the rmm headers from thelibrmm
wheel) are found at a different path on each build in CI.Path changes lead to cache misses with
sccache
, and therefore longer-running and more memory-intensive builds.As more of RAPIDS build-time dependencies are provided wheels (e.g. #33), this problem is going to get worse (see #33 (comment)).
This issue tracks the work of removing build isolation in RAPIDS wheel-building CI jobs.
Benefits of this work
Better
sccache
hit rate = faster, cheaper CI (contributes to #95).Stronger guarantees that packages built in CI are actually installed at test time (i.e. would close #79).
Acceptance Criteria
--no-build-isolation
Approach
Follow the approach from rapidsai/cuspatial#1473.
Notes
These can be done in any order.
Updates
The text was updated successfully, but these errors were encountered: