Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Alluxio, formerly Tachyon, Unify Data at Memory Speed

Alluxio filesystem spec implementation

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Alluxio Python client - Access Any Data Source with Python

A specification that python filesystems should adhere to.

AI reference architecture with Alluxio

A distributed compute and storage engine

The reference implementation of the Linux FUSE (Filesystem in Userspace) interface

File system test suite.

State-of-the-art 2D and 3D Face Analysis Project

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

jnifuse

Fluid, elastic data abstraction layer for BigData/AI applications in cloud native systems

A command line tool for interacting with cloud storage services.

Open source Java implementation for Raft consensus protocol.