🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

RES-Q: Evaluating the Code-Editing Capability of Large Language Model Systems at the Repository Scale

The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>

This repository is a curated collection of the most exciting and influential CVPR 2024 papers. 🔥 [Paper + Code + Demo]

LLM101n: Let's build a Storyteller

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

Simplified Masked Diffusion Language Model

Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Fast and memory-efficient exact attention

Home of StarCoder2!

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Diffusion on syntax trees for program synthesis

gpt-2 from scratch in mlx

A Python framework for high performance GPU simulation and graphics

A nanoGPT pipeline packed in a spreadsheet

Implementation for MatMul-free LM.

"XRec: Large Language Models for Explainable Recommendation"

Mamba SSM architecture

Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models

Mora: More like Sora for Generalist Video Generation

Large Action Model framework to develop AI Web Agents

Code for reproducing our paper "Not All Language Model Features Are Linear"

Scalable neural net training via automatic normalization in the modular norm.

LoRA-Ensemble: Efficient Uncertainty Modelling for Self-attention Networks

This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM