https://github.com/allenai/objaverse-xl
🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!
https://github.com/allenai/objaverse-xl
3d blender computer-vision image-to-3d objaverse python text-to-3d
Last synced: 7 months ago
JSON representation
🪐 Objaverse-XL is a Universe of 10M+ 3D Objects. Contains API Scripts for Downloading and Processing!
- Host: GitHub
- URL: https://github.com/allenai/objaverse-xl
- Owner: allenai
- License: apache-2.0
- Created: 2023-09-15T18:41:54.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-27T17:45:06.000Z (over 1 year ago)
- Last Synced: 2025-03-06T23:46:02.773Z (about 1 year ago)
- Topics: 3d, blender, computer-vision, image-to-3d, objaverse, python, text-to-3d
- Language: Python
- Homepage: https://objaverse.allenai.org/
- Size: 97.7 KB
- Stars: 871
- Watchers: 10
- Forks: 57
- Open Issues: 54
-
Metadata Files:
- Readme: README.md
- Changelog: HISTORY.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - allenai/objaverse-xl - XL是一个包含超过1000万个3D对象的宇宙级数据集。该项目提供API脚本，方便用户下载和处理这些3D模型。Objaverse-XL的目标是构建一个庞大且易于访问的3D对象库，用于各种研究和应用。用户可以利用提供的脚本，根据自己的需求筛选、下载和处理数据集中的模型。该项目的特色在于其规模庞大，覆盖了广泛的3D对象类型。通过API脚本，用户可以高效地管理和利用这个巨大的3D资源库。Objaverse-XL为3D建模、计算机视觉、机器人等领域的研究人员和开发者提供了宝贵的资源。它极大地简化了获取大规模3D数据的流程，促进了相关领域的发展。 (3D视觉生成重建 / 资源传输下载)
README
# 🪐 Objaverse-XL
This repository contains scripts to download and process Objaverse-XL.
Objaverse-XL is an open dataset of over 10 million 3D objects!
With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities: 🧵👇
## Scale Comparison
Objaverse 1.0 was released back in December. It was a step in the right direction, but still relatively small with 800K objects.
Objaverse-XL is over an order of magnitude larger and much more diverse!
## Unlocking Generalization
Compared to the original Zero123 model, Zero123-XL improves remarkably in 0-shot generalization abilities, even being able to perform novel view synthesis on sketches, cartoons, and people!
A ton more examples in the [📝 paper](https://arxiv.org/abs/2307.05663) :)
## Image → 3D
With the base Zero123-XL foundation model, we can perform image → 3D using [DreamFusion](https://dreamfusion3d.github.io/), having the model guide a NeRF to generate novel views!
https://github.com/allenai/objaverse-rendering/assets/28768645/571852cd-dc02-46ce-b2bb-88f64a67d0ac
## Text → 3D
Text-to-3D comes for free with text → image models, such as with SDXL here, providing the initial image!
https://github.com/allenai/objaverse-rendering/assets/28768645/96255b42-8158-4c7a-8308-7b0f1257ada8
## Scaling Trends
Beyond that, we show strong scaling trends for both Zero123-XL and [PixelNeRF](https://alexyu.net/pixelnerf/)!
## Tutorial
Check out the [Google Colab tutorial](https://colab.research.google.com/drive/15XpZMjrHXuky0IgBbXcsUtb_0g-XWYmN?usp=sharing) to download Objaverse-XL .
Polycam data is available by Polycam to academic researchers for non-commercial use upon request and approval from Polycam. For access please fill out [this form](https://forms.gle/HUjYVtS9GKVS5QBXA).
## Blender Rendering
Blender rendering scripts are available in the [scripts/rendering directory](https://github.com/allenai/objaverse-xl/tree/main/scripts/rendering)!
## License
The use of the dataset as a whole is licensed under the ODC-By v1.0 license. Individual objects in Objaverse-XL are licensed under different licenses.
## Citation
To cite Objaverse-XL, please cite our [📝 arXiv](https://arxiv.org/abs/2307.05663) paper with the following BibTeX entry:
```bibtex
@article{objaverseXL,
title={Objaverse-XL: A Universe of 10M+ 3D Objects},
author={Matt Deitke and Ruoshi Liu and Matthew Wallingford and Huong Ngo and
Oscar Michel and Aditya Kusupati and Alan Fan and Christian Laforte and
Vikram Voleti and Samir Yitzhak Gadre and Eli VanderBilt and
Aniruddha Kembhavi and Carl Vondrick and Georgia Gkioxari and
Kiana Ehsani and Ludwig Schmidt and Ali Farhadi},
journal={arXiv preprint arXiv:2307.05663},
year={2023}
}
```
Objaverse 1.0 is available on 🤗Hugging Face at [@allenai/objaverse](https://huggingface.co/datasets/allenai/objaverse). To cite it, use:
```bibtex
@article{objaverse,
title={Objaverse: A Universe of Annotated 3D Objects},
author={Matt Deitke and Dustin Schwenk and Jordi Salvador and Luca Weihs and
Oscar Michel and Eli VanderBilt and Ludwig Schmidt and
Kiana Ehsani and Aniruddha Kembhavi and Ali Farhadi},
journal={arXiv preprint arXiv:2212.08051},
year={2022}
}
```