BERT-like NLP models implemented in OCaml using the ocaml-torch PyTorch bindings.
These are based on the rust-bert implementation which itself is a port of Huggingface's Transformers to Rust.
The models implemented so far are:
-
DistillBERT: pre-trained weights are available under the Apache 2.0 license from Huggingface. weights file, vocabulary file.
-
BERT: pre-trained weights are available under the Apache 2.0 license from Google and hosted by Huggingface. weights file, vocabulary file.