LLM inference in C/C++

ClickHouse® is a real-time analytics DBMS

Android real-time display control software

Tensor library for machine learning

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text

This plugin integrates Azure Speech Cognitive Services in Unreal Engine.

fastertransformer for codegeex model

NextHuman 3D超写实/卡通/异型数字人UESDK