AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

A Native-PyTorch Library for LLM Fine-tuning

AirLLM 70B inference with single 4GB GPU

Large Language Model Text Generation Inference

A high-throughput and memory-efficient inference and serving engine for LLMs

A generative speech model for daily dialogue.

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

Large Language Model Text Generation Inference on Habana Gaudi

Port of OpenAI's Whisper model in C/C++

Faster Whisper transcription with CTranslate2

基于大模型搭建的聊天机器人，同时支持 微信公众号、企业微信应用、飞书、钉钉 等接入，可选择GPT3.5/GPT-4o/GPT-o1/ Claude/文心一言/讯飞星火/通义千问/ Gemini/GLM-4/Claude/Kimi/LinkAI，能处理文本、语音和图片，访问操作系统和互联网，支持基于自有知识库进行定制企业智能客服。

Inference code for Llama models

A latent text-to-image diffusion model

Using Low-rank adaptation to quickly fine-tune diffusion models.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

Stable Diffusion web UI

GPT-3: Language Models are Few-Shot Learners

Embree ray tracing kernels repository.

Streaming server for Unity

GamingAnywhere: An Open Cloud Gaming System

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.