A fast communication-overlapping library for tensor parallelism on GPUs.

UNet diffusion model in pure CUDA

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

A native PyTorch Library for large model training

Ring attention implementation with flash attention

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

LLM training in simple, raw C/CUDA

LL3M: Large Language and Multi-Modal Model in Jax

Elucidating the Design Space of Diffusion-Based Generative Models (EDM)

Karras et al. (2022) diffusion models for PyTorch

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Building blocks for foundation models.

Robust Speech Recognition via Large-Scale Weak Supervision

Easy generative modeling in PyTorch.

Simple, safe way to store and distribute tensors

Annotated version of the Mamba paper

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

A 2D Gaussian Splatting paper for no obvious reasons. Enjoy!

OneDiff: An out-of-the-box acceleration library for diffusion models.

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023

[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale

[ECCV 2024] Tokenize Anything via Prompting

Examples for MS-AMP package.

Mamba SSM architecture

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Code for the paper "Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models"

Master programming by recreating your favorite technologies from scratch.