Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move away from HuggingFace Accelerate #51

Open
gpauloski opened this issue Jun 1, 2023 · 0 comments
Open

Move away from HuggingFace Accelerate #51

gpauloski opened this issue Jun 1, 2023 · 0 comments
Assignees
@gpauloski
Labels
enhancement New features or improvements to existing functionality
Milestone
v0.1.0

Comments

@gpauloski
Copy link
Owner

Describe the Request

Accelerate is a nice package, but the way it handles FP16 means we do not get the memory savings we need. We should move it back to the provided engine utilities and remove the accelerate dependency.

Sample Code

No response

Additional Code or Information

No response
@gpauloski gpauloski added the enhancement New features or improvements to existing functionality label Jun 1, 2023
@gpauloski gpauloski self-assigned this Jun 1, 2023
@gpauloski gpauloski added this to the v0.1.0 milestone Jun 1, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gpauloski gpauloski

Labels
enhancement New features or improvements to existing functionality
Projects
None yet
Milestone
v0.1.0
Development

No branches or pull requests
1 participant
@gpauloski