Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

Controllable video and image Generation, SVD, Animate Anyone, ControlNet, ControlNeXt, LoRA

Official codes of VEnhancer: Generative Space-Time Enhancement for Video Generation

Official repository for the paper PLLaVA

[TPAMI'23] Unifying Flow, Stereo and Depth Estimation

[ECCV 2024] MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model.

Uses opencv to detect when a camera is panning or zooming.

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

A reading list of video generation

[CSUR] A Survey on Video Diffusion Models

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

[ICML 2024] EvTexture: Event-driven Texture Enhancement for Video Super-Resolution

Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

SEED-Story: Multimodal Long Story Generation with Large Language Model

ASCII generator (image to text, image to image, video to video)

CUDA on ??? GPUs

A Gradio web UI for Large Language Models.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

An efficient video loader for deep learning with smart shuffling that's super easy to digest

[ECCV 2024] DragAnything: Motion Control for Anything using Entity Representation

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration

Sampling profiler for Python programs

ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wild. ECCV 2022.

Official Code for MotionCtrl [SIGGRAPH 2024]

[ECCV 2024, Oral] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors