You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now NeMo-Curator has a mix of both CPU and GPU features. However it requires a cuda GPU to be present since the GPU dependencies are imported during library import and that ends up looking for cuda drivers.
Proposed Solution:
Move GPU accelerated versions of modules to an optional import that is not a requirement during library import.
Create an optional dependency while installing NeMo-Curator (maybe something like nemo-curator[cuda12x] following a similar convention to libraries like spacy/cupy/cuDF etc.
The text was updated successfully, but these errors were encountered:
Completed via #27. pip install . will only install CPU dependencies and return placeholder objects for GPU libraries that throw an error if used. pip install "--extra-index-url https://pypi.nvidia.com ".[cuda12x]" will now pull in the GPU dependencies and relevant packages.
Right now NeMo-Curator has a mix of both CPU and GPU features. However it requires a cuda GPU to be present since the GPU dependencies are imported during library import and that ends up looking for cuda drivers.
Proposed Solution:
nemo-curator[cuda12x]
following a similar convention to libraries likespacy/cupy/cuDF
etc.The text was updated successfully, but these errors were encountered: