DataComp for Language Models

TLLM_QMM strips the implementation of quantized kernels of Nvidia's TensorRT-LLM, removing NVInfer dependency and exposes ease of use Pytorch module. We modified the dequantation and weight preproc…

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Golang Version Manager

保存微信历史版本

This is our own implementation of 'Layer Selective Rank Reduction'

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Official implementations for paper: Anydoor: zero-shot object-level image customization

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

FaceChain is a deep-learning toolchain for generating your Digital-Twin.

Yuan 2.0 Large Language Model

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

Fast and memory-efficient exact attention

Ongoing research training transformer language models at scale, including: BERT & GPT-2

GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

TigerBot: A multi-language multi-task LLM

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

This repo is a pipeline of VITS finetuning for fast speaker adaptation TTS, and many-to-many voice conversion

SoftVC VITS Singing Voice Conversion

🔊 Text-Prompted Generative Audio Model

A Gradio web UI for Large Language Models.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

A playbook for systematically maximizing the performance of deep learning models.

LLM training code for Databricks foundation models

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)