A curated list of awesome Machine Learning frameworks, libraries and software.

LlamaIndex is a data framework for your LLM applications

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

The Open Source Feature Store for Machine Learning

VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Code for GPT-4chan

A Benchmark Tool for VectorDB

A natural language search microservice

Milvus Command Line

Cuttle automates the transformation of your Python notebook into deployment-ready projects (API, ML pipeline, or just a Python script)

Milvus Command Line