Discover OpenGVLab/Multitask-Model-Selector Open Source project

Stars
27
Rank 905,827 (Top 18 %)
Language
Python
Created about 1 year ago
Updated 8 months ago

OpenGVLab

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Implementation of Foundation Model is Efficient Multimodal Multitask Model Selector

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Python

5,753

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

Python

5,717

DragGAN

Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）

Python

4,996

InternGPT

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Python

3,198

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

Python

2,984

InternImage

[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

Python

2,502

InternVideo

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

VisionLLM

VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

Python

787

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

Python

691

VideoMAEv2

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

Python

486

DCNv4

[CVPR 2024] Deformable Convolution v4

Python

463

all-seeing

[ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of the Open World"

Python

452

GITM

Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory

445

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

Python

428

Vision-RWKV

Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures

Python

352

CaFo

[CVPR 2023] Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners

Python

344

PonderV2

PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm

Python

311

LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents

Python

296

UniFormerV2

[ICCV2023] UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer

Python

280

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

Python

276

OmniCorpus

OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text

Python

259

HumanBench

This repo is official implementation of HumanBench (CVPR2023)

Python

231

Instruct2Act

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

Python

223

EfficientQAT

EfficientQAT: Efficient Quantization-Aware Training for Large Language Models

Python

198

gv-benchmark

General Vision Benchmark, GV-B, a project from OpenGVLab

Python

189

ControlLLM

ControlLLM: Augment Language Models with Tools by Searching on Graphs

Python

181

InternVideo2

152

UniHCP

Official PyTorch implementation of UniHCP

Python

149

efficient-video-recognition

Python

114

SAM-Med2D

Official implementation of SAM-Med2D

Jupyter Notebook

114

EgoVideo

[CVPR 2024 Champions] Solutions for EgoVis Chanllenges in CVPR 2024

Jupyter Notebook

103

DiffRate

[ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging techniques, while incorporating a differentiable compression rate.

Jupyter Notebook

MMT-Bench

ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI

Python

Awesome-DragGAN

Awesome-DragGAN: A curated list of papers, tutorials, repositories related to DragGAN

MM-NIAH

This is the official implementation of the paper "Needle In A Multimodal Haystack"

Python

M3I-Pretraining

STM-Evaluation

Python

MUTR

[AAAI 2024] Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation

Python

LCL

Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning

Python

ChartAst

ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.

Python

LORIS

Long-Term Rhythmic Video Soundtracker, ICML2023

Python

DDPS

Official Implementation of "Denoising Diffusion Semantic Segmentation with Mask Prior Modeling"

Python

Awesome-LLM4Tool

A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools

PIIP

NeurIPS 2024 Spotlight ⭐️ Parameter-Inverted Image Pyramid Networks (PIIP)

Python

InternVL-MMDetSeg

Train InternViT-6B in MMSegmentation and MMDetection with DeepSpeed

Jupyter Notebook

GUI-Odyssey

GUI Odyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUI Odyssey consists of 7,735 episodes from 6 mobile devices, spanning 6 types of cross-app tasks, 201 apps, and 1.4K app combos.

Python

Siamese-Image-Modeling

[CVPR 2023]Implementation of Siamese Image Modeling for Self-Supervised Vision Representation Learning

Python

De-focus-Attention-Networks

Learning 1D Causal Visual Representation with De-focus Attention Networks

Python

Official-ConvMAE-Det

Python

perception_test_iccv2023

Champion Solutions repository for Perception Test challenges in ICCV2023 workshop.

Python

opengvlab.github.io

MovieMind

EmbodiedGPT

DriveMLM

.github

OpenGVLab/Multitask-Model-Selector

OpenGVLab

Reviews

Repository Details

More Repositories