Geo-Neus
This is the official repo for the implementation of Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction, Qiancheng Fu*, Qingshan Xu*, Yew-Soon Ong, Wenbing Tao (* Equal Contribution), NeurIPS 2022.
We will release our pretrained models soon!
Setup
Installation
This code is built with pytorch 1.11.0 and pytorch3d 0.6.2. In addition, other packages listed in requirements.txt are required.
You can create an anaconda environment called geoneus with the required dependencies by running:
conda create -n geoneus python=3.7
conda activate geoneus
conda install pytorch==1.11.0 torchvision==0.12.0 cudatoolkit=11.3 -c pytorch
conda install fvcore iopath
conda install -c bottler nvidiacub
conda install pytorch3d -c pytorch3d
pip install -r requirements.txt
Data
Download the DTU data from Google Drive, which provides the files on sparse points and image pairs.
Running
- Training
python exp_runner.py --mode train --conf ./confs/womask.conf --case <case_name>
- Extract surface from trained model
python exp_runner.py --mode validate_mesh --conf ./confs/womask.conf --case <case_name> --is_continue
- Evaluation
python eval.py --conf ./confs/womask.conf --case <case_name>
Citation
If you find our work useful in your research, please consider citing:
@article{Fu2022GeoNeus,
title={Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstruction},
author={Fu, Qiancheng and Xu, Qingshan and Ong, Yew-Soon and Tao, Wenbing},
journal={Advances in Neural Information Processing Systems (NeurIPS)},
year={2022}
}
Acknowlegement
Our code is partially based on NeuS project and some code snippets are borrowed from NeuralWarp. Thanks for these great projects.