Official Implementation of Paper *Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for Gradient*

Train and Infer Powerful Sentence Embeddings with AnglE | 🔥 SOTA on STS and MTEB Leaderboard

code for piccolo embedding model from SenseTime

A Closer Look into Mixture-of-Experts in Large Language Models

Unify Efficient Fine-Tuning of 100+ LLMs

🔊 Text-Prompted Generative Audio Model

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

A Honkai Star Rail optimizer, relic scorer, damage calculator, and various other tools for building and gearing characters

AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark

This is a collection of our research on efficient AI, covering hardware-aware NAS and model compression.

Awesome list for LLM pruning.

A fast inference library for running LLMs locally on modern consumer-class GPUs

A high-throughput and memory-efficient inference and serving engine for LLMs

An easy-to-use package for implementing SmoothQuant for LLMs

[ICLR 2024] Unveiling the Pitfalls of Knowledge Editing for Large Language Models

A curated list of Large Language Model (LLM) Interpretability resources.

A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide researchers, practitioners, and enthusiasts with insights i…

Restore safety in fine-tuned language models through task arithmetic

Weak-to-Strong Jailbreaking on Large Language Models

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

Achieving Efficient Alignment through Learned Correction

LongAlign: A Recipe for Long Context Alignment Encompassing Data, Training, and Evaluation

A game server reimplementation for a certain turn-based anime game

Code associated with Tuning Language Models by Proxy (Liu et al., 2024)

A guidance language for controlling large language models.

Landing Page for TOFU

A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning. arXiv:2307.09218.

Enjoy the magic of Diffusion models!

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audi…