Spaces:
Running
on
Zero
Running
on
Zero
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ sdk: gradio
|
|
| 7 |
sdk_version: 6.1.0
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
-
license:
|
| 11 |
short_description: Multi-view image to 3D generation
|
| 12 |
---
|
| 13 |
|
|
@@ -18,69 +18,6 @@ This fork extends [TRELLIS.2](https://github.com/microsoft/TRELLIS.2) with multi
|
|
| 18 |
## What's New
|
| 19 |
|
| 20 |
- **Multi-image conditioning**: Use multiple views for better 3D reconstruction
|
| 21 |
-
- **Windows support**: Runs on Windows with automatic
|
| 22 |
|
| 23 |
> For the interactive visualization tool, see the [viser_view branch](https://github.com/OpsiClear/Trellis2_multi_image_conditioning/tree/viser_view).
|
| 24 |
-
|
| 25 |
-
## Installation
|
| 26 |
-
|
| 27 |
-
```sh
|
| 28 |
-
git clone https://github.com/OpsiClear/Trellis2_multi_image_conditioning.git --recursive
|
| 29 |
-
cd Trellis2_multi_image_conditioning
|
| 30 |
-
. ./setup.sh --new-env --basic --flash-attn --nvdiffrast --nvdiffrec --cumesh --o-voxel --flexgemm
|
| 31 |
-
```
|
| 32 |
-
|
| 33 |
-
> On Windows, `flash-attn` is unavailable. The code automatically falls back to PyTorch's native `sdpa` backend.
|
| 34 |
-
|
| 35 |
-
## Usage
|
| 36 |
-
|
| 37 |
-
### Multi-Image Generation
|
| 38 |
-
|
| 39 |
-
```python
|
| 40 |
-
from trellis2.pipelines import Trellis2ImageTo3DPipeline
|
| 41 |
-
from PIL import Image
|
| 42 |
-
|
| 43 |
-
pipeline = Trellis2ImageTo3DPipeline.from_pretrained("microsoft/TRELLIS.2-4B")
|
| 44 |
-
pipeline.cuda()
|
| 45 |
-
|
| 46 |
-
# Load multiple views
|
| 47 |
-
images = [Image.open(f"view_{i}.png") for i in range(4)]
|
| 48 |
-
|
| 49 |
-
# Generate with multi-image conditioning
|
| 50 |
-
mesh = pipeline.run_multi_image(images)[0]
|
| 51 |
-
```
|
| 52 |
-
|
| 53 |
-
Or run the example:
|
| 54 |
-
```sh
|
| 55 |
-
python example_multi_image.py
|
| 56 |
-
```
|
| 57 |
-
|
| 58 |
-
### Other Examples
|
| 59 |
-
|
| 60 |
-
```sh
|
| 61 |
-
python example.py # Single image generation
|
| 62 |
-
python app.py # Gradio web demo
|
| 63 |
-
python example_texturing.py # PBR texture generation
|
| 64 |
-
python app_texturing.py # Texture generation web demo
|
| 65 |
-
```
|
| 66 |
-
|
| 67 |
-
## Attribution
|
| 68 |
-
|
| 69 |
-
This project is a fork of [TRELLIS.2](https://github.com/microsoft/TRELLIS.2) by Microsoft Corporation, originally released under the MIT License.
|
| 70 |
-
|
| 71 |
-
For full documentation, training instructions, and model details, see the original repository.
|
| 72 |
-
|
| 73 |
-
If you use this code, please cite the original paper:
|
| 74 |
-
|
| 75 |
-
```bibtex
|
| 76 |
-
@article{xiang2025trellis2,
|
| 77 |
-
title={Native and Compact Structured Latents for 3D Generation},
|
| 78 |
-
author={Xiang, Jianfeng and Chen, Xiaoxue and Xu, Sicheng and Wang, Ruicheng and Lv, Zelong and Deng, Yu and Zhu, Hongyuan and Dong, Yue and Zhao, Hao and Yuan, Nicholas Jing and Yang, Jiaolong},
|
| 79 |
-
journal={Tech report},
|
| 80 |
-
year={2025}
|
| 81 |
-
}
|
| 82 |
-
```
|
| 83 |
-
|
| 84 |
-
## License
|
| 85 |
-
|
| 86 |
-
The original TRELLIS.2 code is MIT licensed by Microsoft Corporation. New additions in this fork (multi-image conditioning) are licensed under [AGPL-3.0](LICENSE).
|
|
|
|
| 7 |
sdk_version: 6.1.0
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
+
license: other
|
| 11 |
short_description: Multi-view image to 3D generation
|
| 12 |
---
|
| 13 |
|
|
|
|
| 18 |
## What's New
|
| 19 |
|
| 20 |
- **Multi-image conditioning**: Use multiple views for better 3D reconstruction
|
| 21 |
+
- **Windows support**: Runs on Windows with automatic sdpa attention fallback
|
| 22 |
|
| 23 |
> For the interactive visualization tool, see the [viser_view branch](https://github.com/OpsiClear/Trellis2_multi_image_conditioning/tree/viser_view).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|