Skip to content

Commit

Permalink
Make MobileBert tokenizers independent from Bert (#19531)
Browse files Browse the repository at this point in the history 
* Make `MobileBert` tokenizers independent from `Bert`

* Update src/transformers/models/mobilebert/tokenization_mobilebert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Fixed the name in the error message

* Update src/transformers/models/mobilebert/tokenization_mobilebert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Removed extra space from the "copied" comment

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
  • Loading branch information
@501Good @sgugger
501Good and sgugger authored Oct 12, 2022
1 parent c7ad3ff commit 4edb3e4
Show file tree
Hide file tree
Showing 2 changed files with 604 additions and 14 deletions.
Loading

0 comments on commit 4edb3e4

Please sign in to comment.