Ongoing research training transformer language models at scale, including: BERT & GPT-2

Quantized inference code for LLaMA models

Style-Bert-VITS2: Bert-VITS2 with more controllable voice styles.

Best practice for training LLaMA models in Megatron-LM

Script for downloading GitHub.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Improved version of GECToR

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

🚀 Implementation of easy-to-use 3D parallelism based on Huggingface Transformers & Microsoft DeepSpeed

An easy-to-use but functional retry decorator in python

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

WaveRNN Vocoder + TTS

instagram crawler use python