• Stars
    star
    349
  • Rank 121,528 (Top 3 %)
  • Language
  • Created almost 3 years ago
  • Updated 8 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This is a list of awesome paper about optical flow and related work.

Awesome-Optical-Flow

This is a list of awesome articles about optical flow and related work. Click here to read in full screen.

The table of contents is on the left side of the "README.md".

Optical Flow

Supervised Models

Time Paper Repo
NeurIPS22 SKFlow: Learning Optical Flow with Super Kernels SKFlow Github stars
ECCV22 Disentangling architecture and training for optical flow Autoflow Github stars
ECCV22 FlowFormer: A Transformer Architecture for Optical Flow FlowFormer Github stars
CVPR22 Learning Optical Flow with Kernel Patch Attention KPAFlow Github stars
CVPR22 GMFlow: Learning Optical Flow via Global Matching gmflow Github stars
CVPR22 Deep Equilibrium Optical Flow Estimation deq-flow Github stars
ICCV21 High-Resolution Optical Flow from 1D Attention and Correlation flow1dGithub stars
ICCV21 Learning to Estimate Hidden Motions with Global Motion Aggregation GMA Github stars
CVPR21 Learning Optical Flow from a Few Matches SCV Github stars
TIP21 Detail Preserving Coarse-to-Fine Matching for Stereo Matching and Optical Flow
ECCV20 RAFT: Recurrent All Pairs Field Transforms for Optical Flow RAFT Github stars
CVPR20 MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Mask MaskFlownet Github stars
CVPR20 ScopeFlow: Dynamic Scene Scoping for Optical Flow ScopeFlow Github stars
TPAMI20 A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization LiteFlowNet2 Github stars

Multi-Frame Supervised Models

Time Paper Repo
arXiv23.06 Tracking Everything Everywhere All at Once
ICCV23 VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation VideoFlow Github stars
ECCV22 Particle Video Revisited: Tracking Through Occlusions Using Point Trajectories PIPs Github stars

Semi-Supervised Models

Time Paper Repo
ECCV22 Semi-Supervised Learning of Optical Flow by Flow Supervisor

Data Synthesis

Time Paper Repo
ECCV22 RealFlow: EM-based Realistic Optical Flow Dataset Generation from Videos RealFlow Github stars
CVPR21 AutoFlow: Learning a Better Training Set for Optical Flow autoflow Github stars
CVPR21 Learning Optical Flow from Still Images depthstillation Github stars
arXiv21.04 Optical Flow Dataset Synthesis from Unpaired Images

Unsupervised Models

Time Paper Repo
ECCV22 Optical Flow Training under Limited Label Budget via Active Learning optical-flow-active-learning-release Github stars
CVPR21 SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warping smurf GoogleResearch
CVPR21 UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learning UPFlow_pytorch Github stars
TIP21 OccInpFlow: Occlusion-Inpainting Optical Flow Estimation by Unsupervised Learning depthstillation Github stars
ECCV20 What Matters in Unsupervised Optical Flow uflow GoogleResearch
CVPR20 Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimation ARFlow Github stars
CVPR20 Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo Matching

Joint Learning

Time Paper Repo
arXiv21.11 Unifying Flow, Stereo and Depth Estimation unimatch Github stars
CVPR21 EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentation
CVPR21 Feature-Level Collaboration: Joint Unsupervised Learning of Optical Flow, Stereo Depth and Camera Motion

Special Scene

Time Paper Repo
ECCV22 Deep 360โˆ˜ Optical Flow Estimation Based on Multi-Projection Fusion
AAAI21 Optical flow estimation from a single motion-blurred image
CVPR20 Optical Flow in Dense Foggy Scenes using Semi-Supervised Learning
CVPR20 Optical Flow in the Dark Optical-Flow-in-the-Dark Github stars

Special Device

Event Camera event-based_vision_resources Github stars

Time Paper Repo
ArXiv23.03 Learning Optical Flow from Event Camera with Rendered Dataset
ECCV22 Secrets of Event-Based Optical Flow event_based_optical_flow Github stars
ICCV21 GyroFlow: Gyroscope-Guided Unsupervised Optical Flow Learning GyroFlow Github stars

Scene Flow

Time Paper Repo
CVPR21 RAFT-3D: Scene Flow Using Rigid-Motion Embeddings
CVPR21 Just Go With the Flow: Self-Supervised Scene Flow Estimation Just-Go-with-the-Flow-Self-Supervised-Scene-Flow-Estimation Github stars
CVPR21 Learning to Segment Rigid Motions from Two Frames rigidmaskGithub stars
CVPR20 Upgrading Optical Flow to 3D Scene Flow through Optical Expansion expansion Github stars
CVPR20 Self-Supervised Monocular Scene Flow Estimation self-mono-sf Github stars

Applications

Video Synthesis

Time Paper Repo
CVPR23 A Dynamic Multi-Scale Voxel Flow Network for Video Prediction DMVFN Github stars
CVPR23 Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolation EMA-VFI Github stars
ECCV22 Improving the Perceptual Quality of 2D Animation Interpolation eisai Github stars
ECCV22 Real-Time Intermediate Flow Estimation for Video Frame Interpolation RIFE Github stars
CVPR22 VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution VideoINR Github stars
CVPR22 IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolation IFRNet Github stars
TOG21 Neural Frame Interpolation for Rendered Content
CVPR21 Deep Animation Video Interpolation in the Wild AnimeInterp Github stars
CVPR20 Softmax Splatting for Video Frame Interpolation softmax-splatting Github stars
CVPR20 Adaptive Collaboration of Flows for Video Frame Interpolation AdaCoF-pytorch Github stars
CVPR20 FeatureFlow: Robust Video Interpolation via Structure-to-Texture Generation FeatureFlow Github stars

Video Inpainting

Time Paper Repo
ECCV22 Flow-Guided Transformer for Video Inpainting FGT Github stars
CVPR22 Inertia-Guided Flow Completion and Style Fusion for Video Inpainting isvi Github stars

Video Stabilization

Time Paper Repo
CVPR20 Learning Video Stabilization Using Optical Flow jiyang.fun

Low Level Vision

Time Paper Repo
ICCV21 Deep Reparametrization of Multi-Frame Super-Resolution and Denoising deep-rep Github stars
CVPR21 Deep Burst Super-Resolution deep-burst-sr Github stars
CVPR20 Efficient Dynamic Scene Deblurring Using Spatially Variant Deconvolution Network With Optical Flow Guided Training
TIP20 Deep video super-resolution using HR optical flow estimation SOF-VSR Github stars

Stereo and SLAM

Time Paper Repo
3DV21 RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching RAFT-Stereo Github stars
CVPR20 VOLDOR: Visual Odometry From Log-Logistic Dense Optical Flow Residuals VOLDOR Github stars

Before 2020

Classical Estimation Methods

Time Paper Repo
IJCAI1981 An iterative image registration technique with an application to stereo vision
AI1981 Determining optical flow
TPAMI10 Motion Detail Preserving Optical Flow Estimation
CVPR10 Secrets of Optical Flow Estimation and Their Principles
ICCV13 DeepFlow: Large Displacement Optical Flow with Deep Matching Project
ECCV14 Optical Flow Estimation with Channel Constancy
CVPR17 S2F: Slow-To-Fast Interpolator Flow

Others

Time Paper Repo
NeurIPS19 Volumetric Correspondence Networks for Optical Flow VCN Github stars
CVPR19 Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimation irr Github stars
CVPR18 PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume PWC-Net Github stars
CVPR18 LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation LiteFlowNet Github stars
CVPR17 FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks flownet2-pytorch Github stars
flownet2 Github stars
flownet2-tf Github stars
CVPR17 Optical Flow Estimation using a Spatial Pyramid Network spynet Github stars
ICCV15 FlowNet: Learning Optical Flow with Convolutional Networks FlowNetPytorch Github stars
AAAI19 DDFlow: Learning Optical Flow with Unlabeled Data Distillation DDFlow Github stars
CVPR19 SelFlow: Self-Supervised Learning of Optical Flow SelFlow Github stars
CVPR19 Unsupervised Deep Epipolar Flow for Stationary or Dynamic Scenes EPIFlow Github stars
CVPR18 Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose GeoNet Github stars
ICCV19 RainFlow: Optical Flow under Rain Streaks and Rain Veiling Effect
CVPR18 Robust Optical Flow Estimation in Rainy Scenes
NIPS19 Quadratic Video Interpolation
CVPR19 Depth-Aware Video Frame Interpolation DAIN Github stars
CVPR18 Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation Super-SloMo Github stars
ICCV17 Video Frame Synthesis using Deep Voxel Flow voxel-flow Github stars
CVPR19 DVC: An End-to-end Deep Video Compression Framework PyTorchVideoCompression Github stars
ICCV17 SegFlow: Joint Learning for Video Object Segmentation and Optical Flow SegFlow Github stars
CVPR18 End-to-end Flow Correlation Tracking with Spatial-temporal Attention
CVPR18 Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognition Optical-Flow-Guided-Feature Github stars
GCPR18 On the Integration of Optical Flow and Action Recognition
CVPR14 Spatially Smooth Optical Flow for Video Stabilization

More Repositories

1

ECCV2022-RIFE

ECCV2022 - Real-Time Intermediate Flow Estimation for Video Frame Interpolation
Python
4,075
star
2

shareOI

็ฎ—ๆณ•็ซž่ต›่ฏพไปถๅˆ†ไบซ
3,714
star
3

ICCV2019-LearningToPaint

ICCV2019 - Learning to Paint With Model-based Deep Reinforcement Learning
Python
2,228
star
4

WritingAIPaper

Writing AI Conference Papers: A Handbook for Beginners
1,134
star
5

Practical-RIFE

We are developing more practical approach for users based on RIFE.
Python
438
star
6

CVPR2023-DMVFN

CVPR2023 (highlight) - A Dynamic Multi-Scale Voxel Flow Network for Video Prediction
Jupyter Notebook
316
star
7

NIPS2017-LearningToRunACE

2nd place solution of NIPS2017 LearningToRun Competition.
Python
125
star
8

WACV2024-SAFA

WACV2024 - Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolution
Python
95
star
9

termdic

Dictionary in your terminal
Python
52
star
10

MM2022-ViCoPerceptualHeadGeneration

MM2022 Workshop-Perceptual Conversational Head Generation with Regularized Driver and Enhanced Renderer
Python
49
star
11

NeurIPS2021-ML4CO-KIDA

1st Solution For NeurIPS 2021 Competition on ML4CO Dual Task
Python
27
star
12

brief_paper_reading

My paper reading and insights record
Python
21
star
13

AML

Agent Manipulation Language
C++
17
star
14

Stroke-basedCharacterReconstruction

Stroke-based Character Reconstruction ---> https://arxiv.org/abs/1806.08990
Python
15
star
15

MFSR-TSM

Multi-Frame Super-Resolution based on Temporal Shift Module
Python
9
star
16

ResynNet

Refine video frame based on nearby frames.
Python
7
star
17

hzwer

7
star