Discover showlab/Awesome-Unified-Multimodal-Models Open Source project

Stars
106
Rank 325,871 (Top 7 %)
Language
Created 3 months ago
Updated 3 months ago

showlab

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.

Awesome-Video-Diffusion

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

3,195

Show-1

Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation

Python

1,089

Tune-A-Video

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation

Python

1,010

Image2Paragraph

[A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.

Python

781

MotionDirector

MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

Python

747

Show-o

Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

Python

684

VideoSwap

Code for [CVPR 2024] VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

342

Awesome-MLLM-Hallucination

📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

340

all-in-one

[CVPR2023] All in One: Exploring Unified Video-Language Pre-training

Python

277

BoxDiff

[ICCV 2023] BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion

Python

239

DeVRF

The Pytorch implementation of "DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes"

Python

179

EgoVLP

[NeurIPS2022] Egocentric Video-Language Pretraining

Python

140

VisorGPT

[NeurIPS 2023] Customize spatial layouts for conditional image synthesis models, e.g., ControlNet, using GPT

Python

129

Awesome-GUI-Agent

💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.

109

ShowAnything

Jupyter Notebook

cosmo

Python

loveu-tgve-2023

Official GitHub repository for the Text-Guided Video Editing (TGVE) competition of LOVEU Workshop @ CVPR'23.

Python

sparseformer

(ICLR 2024, CVPR 2024) SparseFormer

Python

datacentric.vlp

Compress conventional Vision-Language Pre-training data

Python

Region_Learner

The Pytorch implementation for "Video-Text Pre-training with Learned Regions"

Python

ShowRoom3D

This is the project page of ShowRoom3D

Long-form-Video-Prior

Python

DemoVLP

[Arxiv2022] Revitalize Region Feature for Democratizing Video-Language Pre-training

Python

CLVQA

[AAAI2023 (Oral)] Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task

Python

BYOC

[IEEE-VR 2024] Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters

Q2A

[ECCV 2022] AssistQ: Affordance-centric Question-driven Task Completion for Egocentric Assistant

Python

HOSNeRF

This is the project page for the HOSNeRF

JavaScript

headshot

GEB-Plus

[ECCV 2022] GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding and Retrieval

Python

LOVA3

[NeurIPS 2024] "Learning to Visual Question Answering, Asking and Assessment"

Python

Show-Anything-3D

Edit and Generate Anything in 3D world!

Awesome-Long-Context

A curated list of resources about long-context in large-language models and video understanding.

SCT

[IJCV2023] Offical implementation of "SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels"

Python

VisInContext

Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

Python

SOIS

The Pytorch implementation of "Single-Stage Open-world Instance Segmentation with Cross-task Consistency Regularization"

AVA-AVD

Python

Efficient-CLS

[arXiv2022] Label-Efficient Online Continual Object Detection in Streaming Video

videollm-online

VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

Python

Tune-An-Ellipse

[CVPR 2024] Tune-An-Ellipse: CLIP Has Potential to Find What You Want

mist

ColonNeRF

This is the project page for ColonNeRF.

JavaScript

DynVideo-E

This is the project page for DynVideo-E.

JavaScript

VideoLISA

[NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos

TTC-Tuning

Revisit Parameter-Efficient Transfer Learning: A Two-Stage Paradigm

assistq

SCSS

showlab/Awesome-Unified-Multimodal-Models

showlab

Reviews

Repository Details

More Repositories