Add paper link, authors and sample usage
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -12,13 +12,16 @@ inference: false
|
|
| 12 |
# ReLi3D
|
| 13 |

|
| 14 |
|
| 15 |
-
**ReLi3D** is a multi-view image-to-3D reconstruction model that takes object images and camera poses and generates a textured, UV-unwrapped, relightable 3D mesh asset.
|
|
|
|
|
|
|
| 16 |
|
| 17 |
Please note: For individuals or organizations generating annual revenue of US $1,000,000 (or local currency equivalent) or more, regardless of the source of that revenue, you must obtain an enterprise commercial license directly from Stability AI before commercially using ReLi3D, or any derivative work of ReLi3D or its outputs, such as fine-tuned models. You may submit a request for an Enterprise License at https://stability.ai/enterprise. Please refer to Stability AI's Community License, available at https://stability.ai/license, for more information.
|
| 18 |
|
| 19 |
### Model Description
|
| 20 |
|
| 21 |
* **Developed by**: [Stability AI](https://stability.ai/)
|
|
|
|
| 22 |
* **Model type**: Transformer multi-view image-to-3D model
|
| 23 |
* **Model details**: ReLi3D is trained to reconstruct a relightable 3D mesh from multiple 512x512 object images with known camera poses. The model outputs UV-unwrapped geometry and texture, and predicts material properties such as roughness and metallic values, together with an estimated illumination representation for downstream rendering workflows.
|
| 24 |
|
|
@@ -30,7 +33,7 @@ Please note: For individuals or organizations generating annual revenue of US $1
|
|
| 30 |
|
| 31 |
* **Repository**: https://github.com/Stability-AI/ReLi3D
|
| 32 |
* **Project page**: https://reli3d.jdihlmann.com/
|
| 33 |
-
* **arXiv page**:
|
| 34 |
|
| 35 |
### Files
|
| 36 |
|
|
@@ -43,7 +46,21 @@ The training process uses renders from Objaverse and curated subsets of addition
|
|
| 43 |
|
| 44 |
## Usage
|
| 45 |
|
| 46 |
-
For usage instructions, please refer to the [ReLi3D GitHub repository](https://github.com/Stability-AI/ReLi3D).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
|
| 48 |
### Intended Uses
|
| 49 |
|
|
@@ -73,3 +90,14 @@ Please report any issues with the model or contact us:
|
|
| 73 |
* Privacy issues: privacy@stability.ai
|
| 74 |
* License and general: https://stability.ai/license
|
| 75 |
* Enterprise license: https://stability.ai/enterprise
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
# ReLi3D
|
| 13 |

|
| 14 |
|
| 15 |
+
**ReLi3D** is a multi-view image-to-3D reconstruction model that takes object images and camera poses and generates a textured, UV-unwrapped, relightable 3D mesh asset.
|
| 16 |
+
|
| 17 |
+
It is the official model for the paper [ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination](https://huggingface.co/papers/2603.19753).
|
| 18 |
|
| 19 |
Please note: For individuals or organizations generating annual revenue of US $1,000,000 (or local currency equivalent) or more, regardless of the source of that revenue, you must obtain an enterprise commercial license directly from Stability AI before commercially using ReLi3D, or any derivative work of ReLi3D or its outputs, such as fine-tuned models. You may submit a request for an Enterprise License at https://stability.ai/enterprise. Please refer to Stability AI's Community License, available at https://stability.ai/license, for more information.
|
| 20 |
|
| 21 |
### Model Description
|
| 22 |
|
| 23 |
* **Developed by**: [Stability AI](https://stability.ai/)
|
| 24 |
+
* **Authors**: Jan-Niklas Dihlmann, Mark Boss, Simon Donne, Andreas Engelhardt, Hendrik P. A. Lensch, Varun Jampani.
|
| 25 |
* **Model type**: Transformer multi-view image-to-3D model
|
| 26 |
* **Model details**: ReLi3D is trained to reconstruct a relightable 3D mesh from multiple 512x512 object images with known camera poses. The model outputs UV-unwrapped geometry and texture, and predicts material properties such as roughness and metallic values, together with an estimated illumination representation for downstream rendering workflows.
|
| 27 |
|
|
|
|
| 33 |
|
| 34 |
* **Repository**: https://github.com/Stability-AI/ReLi3D
|
| 35 |
* **Project page**: https://reli3d.jdihlmann.com/
|
| 36 |
+
* **arXiv page**: https://arxiv.org/abs/2603.19753
|
| 37 |
|
| 38 |
### Files
|
| 39 |
|
|
|
|
| 46 |
|
| 47 |
## Usage
|
| 48 |
|
| 49 |
+
For installation and full usage instructions, please refer to the [ReLi3D GitHub repository](https://github.com/Stability-AI/ReLi3D).
|
| 50 |
+
|
| 51 |
+
### Quickstart
|
| 52 |
+
|
| 53 |
+
To run inference on a set of images and camera poses, you can use the following command from the repository:
|
| 54 |
+
|
| 55 |
+
```bash
|
| 56 |
+
python demos/reli3d/infer_from_transforms.py \
|
| 57 |
+
--input-root demo_files/objects \
|
| 58 |
+
--objects Camera_01 \
|
| 59 |
+
--output-root outputs \
|
| 60 |
+
--num-views 4 \
|
| 61 |
+
--texture-size 256 \
|
| 62 |
+
--overwrite
|
| 63 |
+
```
|
| 64 |
|
| 65 |
### Intended Uses
|
| 66 |
|
|
|
|
| 90 |
* Privacy issues: privacy@stability.ai
|
| 91 |
* License and general: https://stability.ai/license
|
| 92 |
* Enterprise license: https://stability.ai/enterprise
|
| 93 |
+
|
| 94 |
+
## Citation
|
| 95 |
+
|
| 96 |
+
```bibtex
|
| 97 |
+
@inproceeding{ dihlmann2026reli3d,
|
| 98 |
+
author = {Dihlmann, Jan-Niklas and Boss, Mark and Donne, Simon and Engelhardt, Andreas and Lensch, Hendrik P. A. and Jampani, Varun},
|
| 99 |
+
title = {ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination},
|
| 100 |
+
booktitle = {International Conference on Learning Representations (ICLR)},
|
| 101 |
+
year ={2026}
|
| 102 |
+
}
|
| 103 |
+
```
|