📚 C/C++ 技术面试基础知识总结，包括语言、程序库、数据结构、算法、系统、网络、链接装载库等知识及面试经验、招聘、内推等信息。This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, in…

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Open source real-time translation app for Android that runs locally

Speech-to-text, text-to-speech, speaker recognition, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, RISC-V, x86_64 …

ONNX-TensorRT: TensorRT backend for ONNX

Efficient Inference of Transformer models

Pybind11 bindings for Whisper.cpp

Offline Speech Recognition with OpenAI Whisper and TensorFlow Lite for Android

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama的大模型推理框架。

Optimized OpenAI's Whisper TFLite Port for Efficient Offline Inference on Edge Devices

Python bindings for whisper.cpp

Snowboy reimplementation

Python Wrapper of Silero VAD