wangxiao5791509/MultiModal_BigModels_Survey

Stars
278
Rank 148,454 (Top 3 %)
Language
Created almost 3 years ago
Updated about 1 month ago

wangxiao5791509/MultiModal_BigModels_Survey

wangxiao5791509

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

[MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models

This github will be continuously updated for the survey paper:

Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey, Xiao Wang, Guangyao Chen, Guangwu Qian, Pengcheng Gao, Xiao-Yong Wei, Yaowei Wang, Yonghong Tian, Wen Gao. [Paper]

Framework of this survey

Review and Surveys

Please check this file [Surveys.md]

Datasets

Please check this file [Datasets.md]

Publications

Please check this file [paperList.md]

Experimental Analysis

📃 BibTex:

If you find this survey useful for your research, please cite the following papers:

@article{wang2022MMPTMSurvey,
  title={Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey},
  author={Wang, Xiao and Chen, Guangyao and Qian, Guangwu and Gao, Pengcheng and Wei, Xiao-Yong and Wang, Yaowei and Tian, Yonghong and Gao, Wen},
  url={https://github.com/wangxiao5791509/MultiModal_BigModels_Survey},
  year={2022}
}

If you have any questions about this survey, please email me via: [email protected] or [email protected]

Pedestrian-Attribute-Recognition-Paper-List

[Survey@Pattern Recognition] Paper list on Pedestrian Attribute Recognition (PAR) and related tasks (Pattern Recognition 2021)

Single_Object_Tracking_Paper_List

Paper list for single object tracking (State-of-the-art SOT trackers)

VisEvent_SOT_Benchmark

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

Cloth_Change_Person_reID_Paper_List

Paper collection for cloth variation based person re-identification

SNN_CV_Applications_Resources

Paper list for SNN based computer vision tasks.

Person-Search-Paper-List

The paper list for person search

TNL2K_evaluation_toolkit

Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark (CVPR 2021)

RGB-Thermal-Tracking-Paper-List

Paper collection of rgb-infrared tracking algorithms.

RGB-DVS-SOT-Baselines

MFG_RGBT_Tracking_PyTorch

Official implementation of MFG-RGBT-Tracking with PyTorch, IEEE TMM 2022

Tracking-with-Deep-Reinforcement-Learning

cmSalGAN_PyTorch

Official implementation of "cmSalGAN: RGB-D Salient Object Detection with Cross-View Generative Adversarial Networks" (IEEE TMM 2020)

LGSearch_DDGAN_PyTorch

Tracking by Joint Local and Global Search: A Target-aware Attention based Approach (IEEE TNNLS 2021)

DeepMTA_PyTorch

Official implementation of deep-multi-trajectory-based single object tracking (IEEE T-CSVT 2021).

Age-Progression-Regression-by-CAAE

the repaired code of paper "Age Progression/Regression by Conditional Adversarial Autoencoder---CVPR 2017"

Dynamic-Memory-Network-Paper-List

The paper list of dynamic memory network

Spiking-Neural-Network-Paper-List

Paper list for Spiking Neural Networks (SNN)

PET_Principles_and_Applications

Principles and Applications for Positron Emission Tomography (PET)

SiamDW_tracker_revised

EVclouds_Classification_WACV2019

Recognize the Gesture for DVS sensors using Event Clound Method

MultiModality_Spatial_registration_matlab

A toolkit for spatial registration of dual-modal data like rgb and thermal images

RoI_Pooling_PyTorch

A modified version of RoI Pooling function for proposal feature extractation.

RAM-LPM-PyTorch

Recurrent Attention Model with Log-Polar Mapping (RAM-LPM)

Jupyter Notebook

MOT-Paper-List

The paper list for Multi-Object-Tracking

STADB_ReID

Official implementation of "STADB: A Self-Thresholding Attention Guided ADB Network for Person Re-identification"

wangxiao5791509.github.io