革 | kaku

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

A very shy little theme that hides the entire browser interface in the window border

🐂 TorrentPier. Main project repository

Simple encrypted file transfer service

A custom discord client that supports streaming with audio on Linux.

Visualizing the internal board state of a GPT trained on chess PGN strings, and performing interventions on its internal board state and representation of player Elo.

Self-hosted webscraper.

ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.

A multimodal, function calling powered LLM webui.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Simple go utility to download HuggingFace Models and Datasets

Brand new TTS solution

A curated list of modern Generative Artificial Intelligence projects and services

Dockerfile for LanguageTool

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

Loader extension for tabbyAPI in SillyTavern

Index your memes by their content and text, making them easily retrievable for your meme warfare pleasures. Find funny fast.

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Tools for merging pretrained large language models.

Text-generation-webui oneclick UI + API

LLM Frontend in a single html file

TUI for Ollama

Turn any webpage into structured data using LLMs

Web UI for ExLlamaV2