Discover OpenGVLab/ChartAst Open Source project by @OpenGVLab

Stars
46
Rank 594,879 (Top 13 %)
Language
Python
License
Other
Created 5 months ago
Updated 3 months ago

OpenGVLab

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.

LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters

Python

5,526

DragGAN

Unofficial Implementation of DragGAN - "Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold" （DragGAN 全功能实现，在线Demo，本地部署试用，代码、模型已全部开源，支持Windows, macOS, Linux）

Python

4,967

InternGPT

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

Python

3,123

Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

Python

2,695

InternImage

[CVPR 2023 Highlight] InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions

Python

2,315

InternVideo

Video Foundation Models & Data for Multimodal Understanding

Python

954

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V

Python

936

VisionLLM

VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks

554

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

Python

549

VideoMamba

VideoMamba: State Space Model for Efficient Video Understanding

Python

506

GITM

Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory

445

VideoMAEv2

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

Python

375

Multi-Modality-Arena

Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!

Python

374

all-seeing

[ICLR 2024] This is the official implementation of the paper "The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World"

Python

373

CaFo

[CVPR 2023] Prompt, Generate, then Cache: Cascade of Foundation Models makes Strong Few-shot Learners

Python

323

PonderV2

PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm

Python

302

DCNv4

[CVPR 2024] Deformable Convolution v4

Python

269

LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents

Python

267

UniFormerV2

[ICCV2023] UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer

Python

260

Instruct2Act

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

Python

223

unmasked_teacher

[ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models

Python

220

Vision-RWKV

Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures

Python

216

HumanBench

This repo is official implementation of HumanBench (CVPR2023)

Python

207

gv-benchmark

General Vision Benchmark, GV-B, a project from OpenGVLab

Python

187

InternVideo2

152

ControlLLM

ControlLLM: Augment Language Models with Tools by Searching on Graphs

Python

148

UniHCP

Official PyTorch implementation of UniHCP

Python

137

efficient-video-recognition

Python

114

SAM-Med2D

Official implementation of SAM-Med2D

Jupyter Notebook

114

ego4d-eccv2022-solutions

Champion Solutions for Ego4D Chanllenge of ECCV 2022

Jupyter Notebook

Awesome-DragGAN

Awesome-DragGAN: A curated list of papers, tutorials, repositories related to DragGAN

DiffRate

[ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging techniques, while incorporating a differentiable compression rate.

Jupyter Notebook

STM-Evaluation

Python

M3I-Pretraining

DDPS

Official Implementation of "Denoising Diffusion Semantic Segmentation with Mask Prior Modeling"

Python

MUTR

[AAAI 2024] Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation

Python

Awesome-LLM4Tool

A curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools

LORIS

Long-Term Rhythmic Video Soundtracker, ICML2023

Python

Siamese-Image-Modeling

[CVPR 2023]Implementation of Siamese Image Modeling for Self-Supervised Vision Representation Learning

Python

InternVL-MMDetSeg

Train InternViT-6B in MMSegmentation and MMDetection with DeepSpeed

Jupyter Notebook

Multitask-Model-Selector

Implementation of Foundation Model is Efficient Multimodal Multitask Model Selector

Python

Official-ConvMAE-Det

Python

opengvlab.github.io

MovieMind

perception_test_iccv2023

Champion Solutions repository for Perception Test challenges in ICCV2023 workshop.

Python

EmbodiedGPT

DriveMLM

.github

OpenGVLab/ChartAst

OpenGVLab

Reviews

Repository Details

More Repositories