Convert PDF to markdown quickly with high accuracy

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with …

LLM inference in C/C++

🍦 ChatTTS-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

官方推荐的 ChatTTS 资源汇总项目，整理了全网相关资源和常见问题 || Officially recommended ChatTTS resource collection project

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

llama3 implementation one matrix multiplication at a time

OCR, layout analysis, reading order, line detection in 90+ languages

A Python library to extract tabular data from PDFs

Go ahead and axolotl questions

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Use PEFT or Full-parameter to finetune 350+ LLMs or 90+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vi…

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Security and compliance proxy for LLM APIs

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

用 Express 和 Vue3 搭建的 ChatGPT 演示网页

OpenAI 接口管理 & 分发系统，支持 Azure、Anthropic Claude、Google PaLM 2 & Gemini、智谱 ChatGLM、百度文心一言、讯飞星火认知、阿里通义千问、360 智脑以及腾讯混元，可用于二次分发管理 key，仅单可执行文件，已打包好 Docker 镜像，一键部署，开箱即用. OpenAI key management & redistributi…

Container plugin for Slurm Workload Manager

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

🚀 基于大语言模型和 RAG 的知识库问答系统。开箱即用、模型中立、灵活编排，支持快速嵌入到第三方业务系统。

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

This repo includes ChatGPT prompt curation to use ChatGPT better.

Minimal keyword extraction with BERT

structured outputs for llms

Joplin - the privacy-focused note taking app with sync capabilities for Windows, macOS, Linux, Android and iOS.

Fork of turndown-plugin-gfm for Jopin

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)