The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

A high-throughput and memory-efficient inference and serving engine for LLMs

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

🧑‍🏫 59 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cycleg…

An Easy-to-use Speech Toolkit including SOTA ASR pipeline, influential TTS with text frontend and End-to-End Speech Simultaneous Translation.

This is a code repository for pytorch c++ (or libtorch) tutorial.

Tensors and Dynamic neural networks in Python with strong GPU acceleration