• Stars
    star
    1,051
  • Rank 43,536 (Top 0.9 %)
  • Language
    Python
  • License
    Creative Commons ...
  • Created almost 4 years ago
  • Updated 10 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

This repo contains the projects: 'Virtual Normal', 'DiverseDepth', and '3D Scene Shape'. They aim to solve the monocular depth estimation, 3D scene reconstruction from single image problems.

AdelaiDepth

Open In Colab

AdelaiDepth is an open source toolbox for monocular depth prediction. Relevant work from our group is open-sourced here.

AdelaiDepth contains the following algorithms:

News:

  • [May. 31, 2022] Code for local recovery strategy of BoostingDepth is released.
  • [May. 31, 2022] Training code and data of LeReS project have been released.
  • [Feb. 13, 2022] Training code and data of DiverseDepth project have been released.
  • [Jun. 13, 2021] Our "Learning to Recover 3D Scene Shape from a Single Image" work is one of the CVPR'21 Best Paper Finalists.
  • [Jun. 6, 2021] We have made the training data of DiverseDepth available.

Results and Dataset Examples:

  1. 3D Scene Shape

You may want to check this video which provides a very brief introduction to the work:

RGB Depth Point Cloud

Depth

  1. DiverseDepth
  • Results examples:

Depth

  • DiverseDepth dataset examples:

DiverseDepth dataset

BibTeX

@article{yin2022towards,
  title={Towards Accurate Reconstruction of 3D Scene Shape from A Single Monocular Image},
  author={Yin, Wei and Zhang, Jianming and Wang, Oliver and Niklaus, Simon and Chen, Simon and Liu, Yifan and Shen, Chunhua},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
  year={2022}
}

@inproceedings{Yin2019enforcing,
  title     = {Enforcing geometric constraints of virtual normal for depth prediction},
  author    = {Yin, Wei and Liu, Yifan and Shen, Chunhua and Yan, Youliang},
  booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
  year      = {2019}
}

@inproceedings{Wei2021CVPR,
  title     =  {Learning to Recover 3D Scene Shape from a Single Image},
  author    =  {Wei Yin and Jianming Zhang and Oliver Wang and Simon Niklaus and Long Mai and Simon Chen and Chunhua Shen},
  booktitle =  {Proc. IEEE Conf. Comp. Vis. Patt. Recogn. (CVPR)},
  year      =  {2021}
}

@article{yin2021virtual,
  title   = {Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Prediction},
  author  = {Yin, Wei and Liu, Yifan and Shen, Chunhua},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
  year    = {2021}
}

Contact

License

The 3D Scene Shape code is under a non-commercial license from Adobe Research. See the LICENSE file for details.

Other depth prediction projects are licensed under the 2-clause BSD License for non-commercial use -- see the LICENSE file for details. For commercial use, please contact Chunhua Shen.

More Repositories

1

AdelaiDet

AdelaiDet is an open source toolbox for multiple instance-level detection and recognition tasks.
Python
3,349
star
2

Matcher

[ICLR'24] Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching
Python
401
star
3

StyleDrop-PyTorch

This is an unofficial PyTorch implementation of StyleDrop: Text-to-Image Generation in Any Style.
Python
203
star
4

Poseur

[ECCV 2022] The official repo for the paper "Poseur: Direct Human Pose Regression with Transformers".
Python
176
star
5

AutoStory

143
star
6

DyCo3D

Python
119
star
7

GenPercept

GenPercept: Diffusion Models Trained with Large Data Are Transferable Visual Models
Python
112
star
8

FrozenRecon

[ICCV2023] 🧊FrozenRecon: Pose-free 3D Scene Reconstruction with Frozen Depth Models
Python
108
star
9

SegPrompt

Official Implementation of ICCV 2023 Paper - SegPrompt: Boosting Open-World Segmentation via Category-level Prompt Learning
Python
108
star
10

FreeCustom

[CVPR 2024] Official PyTorch implementation of FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition
Python
69
star
11

OIR

[ICLR 2024] Official PyTorch/Diffusers implementation of "Object-aware Inversion and Reassembly for Image Editing"
Python
69
star
12

RGM

68
star
13

GeoBench

A toolbox for benchmarking SOTA discriminative and generative geometry estimation models.
Python
42
star
14

GenDeF

38
star
15

DiverGen

DiverGen (CVPR 2024) & BSGAL (ICML 2024)
Python
32
star
16

partially-labelled

Learning to segment multi-organ and tumorsfrom multiple partially labeled datasets
19
star
17

FreeCompose

13
star
18

VFN

[ICLR 2024 Spotlight] The official repo for the paper "De novo Protein Design using Geometric Vector Field Networks".
Python
12
star
19

VLModel

Repo of HawkLlama.
Python
8
star
20

Depth3D

Python
7
star
21

FADiff

[ICML 2024] Floating Anchor Diffusion Model for Multi-motif Scaffolding
Python
6
star
22

STORY

4
star
23

LoRAPrune

Python
4
star
24

MovieDreamer

4
star
25

OIR-Diffusion

JavaScript
1
star