Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Support linux/arm64 wheels for onnxruntime-gpu #21232

Open
gowthamravichandran opened this issue Jul 2, 2024 · 1 comment
Labels
ep:CUDA issues related to the CUDA execution provider feature request request for unsupported feature or enhancement platform:jetson issues related to the NVIDIA Jetson platform

Comments

@gowthamravichandran
Copy link

Describe the feature request

There are CUDA enabled devices like Nvidia jetson which uses arm64 processors.

Currently, onnxruntime-gpu doesnt support arm64 processors.

Could we enable support for them?

Describe scenario use case

There are a lot of tools which uses onnxruntime-gpu under the hood, since arm64 isnt supported in onnxruntime-gpu, all those tools cannot support arm64 processors.

Publishing arm64 wheels for onnxruntime-gpu would enable all those tools to support arm64 processors

@gowthamravichandran gowthamravichandran added the feature request request for unsupported feature or enhancement label Jul 2, 2024
@github-actions github-actions bot added ep:CUDA issues related to the CUDA execution provider platform:jetson issues related to the NVIDIA Jetson platform labels Jul 2, 2024
@yf711
Copy link
Contributor

yf711 commented Jul 2, 2024

Yes, please follow installation guide to download and install pre-built onnxruntime-gpu for Jetpack users at Jetson Zoo.

You can also build onnxruntime-gpu python wheels on your own jetson device. Here's build guide

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:CUDA issues related to the CUDA execution provider feature request request for unsupported feature or enhancement platform:jetson issues related to the NVIDIA Jetson platform
Projects
None yet
Development

No branches or pull requests

2 participants