Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transformers version forward compatibility #71

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

bviggiano
Copy link
Member

Small fix for the CharacterTokenizer implementation, which breaks in transformers 4.40.0

@bviggiano bviggiano requested a review from exnx June 15, 2024 18:25
@bviggiano bviggiano self-assigned this Jun 15, 2024
@bviggiano bviggiano changed the title Forward compatibility transformers version forward compatibility Jun 15, 2024
@bviggiano
Copy link
Member Author

I tested this implementation with the code in the tutorial, and this now works on both transformers 4.26.1 (original HyneaDNA version) and transformers 4.40.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant