With recent advances in camera manufacturing, light field (LF) imaging technology becomes increasingly popular and is commonly used in various applications such as mobile phones, biological microscope, VR/AR etc. Since both intensity and directions of light rays are recorded by LF cameras, the resolution of LF images can be enhanced by using these additional angular information. LF image super-resolution (SR), also known as LF spatial SR, aims at reconstructing high-resolution (HR) LF images from their low-resolution (LR) counterparts. In this repository, we present a collection of papers on LF image SR, together with their codes and repos.
Note: This repository will be updated on a regular basis, so stay tuned~~πππ
News:
- 2022.12.18: We will organize the first LF image SR challenge on the NTIRE workshop at CVPR 2023. See details at LF-Image-SR/tree/NTIRE2023.
- 2022.06.14: Add a new work YingqianWang/LF-DAnet.
- 2022.02.17: Add a new work YingqianWang/DistgSSR that is accepted to TPAMI.
- 2022.01.23: Update ZhengyuLiang24/LFT that is accepted by IEEE SPL.
- 2022.01.04: Add a new work BITszwang/DPT that is accepted to AAAI 2022.
- 2021.12.09: New version is online, more recent methods are included.
Methods from 2012 to 2022:
| Acronym | Publication | Official Repo |
|---|---|---|
| The light field camera: extended depth of field, aliasing, and superresolution, TPAMI, 2012. | -- | |
| -- | Spatial and angular vriational super-resolution of 4D light fields, ECCV 2012. | -- |
| -- | Variational light field analysis for disparity estimation and super-resolution, TPAMI 2013. | -- |
| LFCNN | Learning a deep convolutional network for light-field image super-resolution, ICCVW 2015; Light field image super-resolution using convolutional neural network, SPL 2017 | youngjinYoon/ SPL_LF_SR |
| PCA_rr | Super resolution of light field images using linear subspace projection of patch-volumes, JSTSP 2017 | -- |
| LFSR_Gul | Spatial and angular resolution enhancement of light fields using convolutional neural networks, TIP 2018 | -- |
| GB | Light field super-resolution via graph-based regularization, TIP 2018 | rossimattia/ light-field-super-resolution |
| LFNet | LFNet: A Novel Bidirectional Recurrent Convolutional Neural Network for Light-Field Image Super-Resolution, TIP 2018 | wylcasia/LFNet |
| LRP | Light field super-resolution using a low-rank prior and deep convolutional neural networks, TPAMI 2018 | -- |
| LFBM5D | Light field super-resolution via LFBM5D sparse coding, ICIP 2018 | V-Sense/ LFBM5D |
| LF-DCNN | Light-field image superresolution using a combined deep CNN based on EPIοΌ SPL 2018. | -- |
| LFSSR-SAS | Light field spatial super-resolution using deep efficient spatial-angular separable convolution, TIP 2018 | jingjin25/ LFSSR-SAS-PyTorch |
| EPGB | Light field super-resolution using edge-preserved graph-based regularization, TMM 2019. | -- |
| LF-FusNet | Light field super-resolution by jointly exploiting internal and external similarities, TCSVT 2019. | Joechann0831/ LFSR-FusNet |
| --- | An epipolar volume autoencoder with adversarial loss for deep light field super-resolution, CVPRW 2019 | MinchenZKN/ LFSR |
| resLF | Residual networks for light field image super-resolution, CVPR 2019 | shuozh/resLF |
| HDDRNet | High-dimensional dense residual convolutional neural network for light field reconstruction, TPAMI 2019 | monaen/ LightFieldReconstruction |
| LF-InterNet | Spatial-angular interaction for light field image super-resolution, ECCV 2020 | YingqianWang/ LF-InterNet |
| LF-ATO | Light field spatial super-resolution via deep combinatorial geometry embedding and structural consistency regularization, CVPR 2020 | jingjin25/ LFSSR-ATO |
| LFDCSR | Deep selective combinatorial embedding and consistency regularization for light field super-resolution, arxiv 2020 | -- |
| LF-DFnet | Light field image super-resolution using deformable convolution, TIP 2020 | YingqianWang/ LF-DFnet |
| LF-ZSSR | Light field super-resolution with zero-shot learning, CVPR 2021 | Joechann0831/ LFZSSR |
| LFSR-AFR | Light field super-resolution via adaptive feature remixing, TIP 2021. | keunsoo-ko/ LFSR-AFR |
| MEG-Net | End-to-end light field spatial super-resolution network using multiple epipolar geometry, TIP 2021. | shuozh/MEG-Net |
| DDAN | Dense dual-attention network for light field image super-resolution, TCSVT 2021. | -- |
| LF-IINet | Intra-inter view interaction network for light field image super-resolution, TMM 2021. | GaoshengLiu/ LF-IINet |
| -- | Cooperative Light-Field Image Super-Resolution based on Multi-Modality Embedding and Fusion with Frequency Attention, SPL 2021. | -- |
| DKNet | Texture-enhanced Light Field Super-resolution with Spatio-Angular Decomposition Kernels, TIM 2022. | huzexi/DKNet |
| DPT | Detail-Preserving Transformer for Light Field Image Super-Resolution, AAAI 2022. | BITszwang/DPT |
| LFT | Light field image super-resolution with Transformers, SPL 2022. | ZhengyuLiang24/LFT |
| DistgSSR | Disentangling Light Fields for Super-Resolution and Disparity Estimation, TPAMI 2022. | YingqianWang/DistgSSR |
| LF-DAnet | Learning a Degradation-Adaptive Network for Light Field Image Super-Resolution, arXiv 2022. | YingqianWang/LF-DAnet |