Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove build isolation in wheel builds #108

Open
19 tasks
jameslamb opened this issue Oct 14, 2024 · 0 comments
Open
19 tasks

Remove build isolation in wheel builds #108

jameslamb opened this issue Oct 14, 2024 · 0 comments
Assignees

Comments

@jameslamb
Copy link
Member

jameslamb commented Oct 14, 2024

Description

Currently, RAPIDS projects build wheels with build isolation, like pip wheel ..

With build isolation, the build tool (in our case, pip wheel), creates a virtual environment and installs of the package's build-time dependencies into it. That virtual environment is created at a random location on each build, which means source files included from other wheels (like the rmm headers from the librmm wheel) are found at a different path on each build in CI.

Path changes lead to cache misses with sccache, and therefore longer-running and more memory-intensive builds.

As more of RAPIDS build-time dependencies are provided wheels (e.g. #33), this problem is going to get worse (see #33 (comment)).

This issue tracks the work of removing build isolation in RAPIDS wheel-building CI jobs.

Benefits of this work

Better sccache hit rate = faster, cheaper CI (contributes to #95).

Stronger guarantees that packages built in CI are actually installed at test time (i.e. would close #79).

Acceptance Criteria

  • all RAPIDS wheels builds in CI build with --no-build-isolation

Approach

Follow the approach from rapidsai/cuspatial#1473.

Notes

These can be done in any order.

Updates

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant