๐ช Objaverse-XL
This repository contains scripts to download and process Objaverse-XL.
Objaverse-XL is an open dataset of over 10 million 3D objects!
With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: ๐งต๐
Scale Comparison
Objaverse 1.0 was released back in December. It was a step in the right direction, but still relatively small with 800K objects.
Objaverse-XL is over an order of magnitude larger and much more diverse!
Unlocking Generalization
Compared to the original Zero123 model, Zero123-XL improves remarkably in 0-shot generalization abilities, even being able to perform novel view synthesis on sketches, cartoons, and people!
A ton more examples in the ๐ paper :)
Image โ 3D
With the base Zero123-XL foundation model, we can perform image โ 3D using DreamFusion, having the model guide a NeRF to generate novel views!
image-to-3d-2.mp4
Text โ 3D
Text-to-3D comes for free with text โ image models, such as with SDXL here, providing the initial image!
text-to-3d-v.mp4
Scaling Trends
Beyond that, we show strong scaling trends for both Zero123-XL and PixelNeRF!
Tutorial
Check out the Google Colab tutorial to download Objaverse-XL .
Polycam data is available by Polycam to academic researchers for non-commercial use upon request and approval from Polycam. For access please fill out this form.
Blender Rendering
Blender rendering scripts are available in the scripts/rendering directory!
License
The use of the dataset as a whole is licensed under the ODC-By v1.0 license. Individual objects in Objaverse-XL are licensed under different licenses.
Citation
To cite Objaverse-XL, please cite our ๐ arXiv paper with the following BibTeX entry:
@article{objaverseXL,
title={Objaverse-XL: A Universe of 10M+ 3D Objects},
author={Matt Deitke and Ruoshi Liu and Matthew Wallingford and Huong Ngo and
Oscar Michel and Aditya Kusupati and Alan Fan and Christian Laforte and
Vikram Voleti and Samir Yitzhak Gadre and Eli VanderBilt and
Aniruddha Kembhavi and Carl Vondrick and Georgia Gkioxari and
Kiana Ehsani and Ludwig Schmidt and Ali Farhadi},
journal={arXiv preprint arXiv:2307.05663},
year={2023}
}Objaverse 1.0 is available on ๐คHugging Face at @allenai/objaverse. To cite it, use:
@article{objaverse,
title={Objaverse: A Universe of Annotated 3D Objects},
author={Matt Deitke and Dustin Schwenk and Jordi Salvador and Luca Weihs and
Oscar Michel and Eli VanderBilt and Ludwig Schmidt and
Kiana Ehsani and Aniruddha Kembhavi and Ali Farhadi},
journal={arXiv preprint arXiv:2212.08051},
year={2022}
}