The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

A Benchmark Tool for VectorDB

LlamaIndex is a data framework for your LLM applications

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.

Code for GPT-4chan

Milvus Command Line

The GUI for Milvus

Visualize hnsw, faiss and other anns index

A cloud-native vector database, storage for next generation AI applications

VizTracer is a low-overhead logging/debugging/profiling tool that can trace and visualize your python code execution.

A curated list of awesome Machine Learning frameworks, libraries and software.

The Open Source Feature Store for Machine Learning

Towhee reference docs

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Milvus Command Line

The helm chart to deploy Milvus

Cuttle automates the transformation of your Python notebook into deployment-ready projects (API, ML pipeline, or just a Python script)

Collections of vector search related libraries, service and research papers

A natural language search microservice

Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.