File size: 4,143 Bytes
7ffd241 34400a7 b723658 7ffd241 34400a7 b723658 34400a7 7c012a4 b723658 34400a7 b723658 34400a7 b723658 7c012a4 b723658 7c012a4 b723658 34400a7 b723658 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 | ---
license: mit
pipeline_tag: image-to-3d
tags:
- image-to-3d
- 3d-generation
- mesh-generation
- pbr
- trellis
base_model:
- microsoft/TRELLIS
---
# TRELLIS.2 4B — image-to-3D with PBR materials
Microsoft's TRELLIS.2 structured-latent 3D generator. **≈100 s** per asset on
an RTX 5090, and unlike most shape models it returns **material already baked
in** — no separate texturing pass.
> **What this repo is:** the TRELLIS.2 4B pipeline at FP16 — weights only, not
> a retrain. The samples below were generated with this build.
---
## Samples
Single image in, textured mesh out. Source images were rendered with Z-Image
Turbo; the meshes are Blender Workbench renders of the raw `.glb` — no
cleanup, no retopology, and **no separate paint stage**.
<table>
<tr><td><img src="https://huggingface.co/ChrisColeTech/TRELLIS.2-4B-FP16/resolve/main/samples/src-robot.png" width="330" alt="source photograph of a retro robot toy"></td><td><img src="https://huggingface.co/ChrisColeTech/TRELLIS.2-4B-FP16/resolve/main/samples/mesh-robot.png" width="330" alt="generated mesh with baked material"></td></tr>
<tr><td><sub>**source** — `a cute chunky retro robot toy standing upright, rounded metal body, simple friendly face, studio product photograph on a plain white background`</sub></td><td><sub>**mesh** — 26.3 MB `.glb`, generated in 98 s, seed 42</sub></td></tr>
<tr><td><img src="https://huggingface.co/ChrisColeTech/TRELLIS.2-4B-FP16/resolve/main/samples/src-teapot.png" width="330" alt="source photograph of a porcelain teapot"></td><td><img src="https://huggingface.co/ChrisColeTech/TRELLIS.2-4B-FP16/resolve/main/samples/mesh-teapot.png" width="330" alt="generated mesh with baked material"></td></tr>
<tr><td><sub>**source** — `an ornate ceramic teapot with a curved spout and handle, glazed blue and white porcelain, studio product photograph`</sub></td><td><sub>**mesh** — 26.3 MB `.glb`, seed 42</sub></td></tr>
</table>
### Turntable
Four views, 90° apart — the back is inferred, not copied from the source.
Note the level of preserved relief: the concentric ear knobs, the recessed
chest display, and the fastener detail across the back panel all survive, and
the surface reads as metal rather than flat clay because material comes out
with the geometry.
## Recommended settings
| Parameter | Production value | Meaning |
|---|---|---|
| `seed` | any | Deterministic per seed |
| input | one RGB(A) image | Centred subject, plain background |
| output | `.glb` | Mesh **with baked material** |
**Supported modes:** `img2mesh`, `txt2mesh`, and the `_textured` variants
### Notes and gotchas
- **Material comes for free.** `img2mesh` already returns a shaded mesh, so
the separate paint stage other shape models need is unnecessary here. That
is the main reason to pick TRELLIS.2 over a pure geometry model.
- **It is the slow tier** — ≈100 s versus ≈20–30 s for a 1.5B geometry-only
model and ≈6 s for a 0.6B one. Use it for finals, not for iteration.
- **Sparse-conv backend.** The pipeline logs
`[SPARSE] Conv backend: flex_gemm; Attention backend: flash_attn` on load
and pulls a `valeoai/NAF` estimator from `torch.hub` the first time — the
first run on a fresh machine needs network access and is slower.
- **Give the GPU to one model at a time.** At ≈4B plus sparse-conv working
memory this wants the card to itself; sharing a GPU with another
model-serving process produces failures that look like crashes rather than
clean out-of-memory errors.
- Generated meshes come out facing the source image's front, so a fixed
camera works across a batch.
---
## Provenance
- **Upstream base model:** [`microsoft/TRELLIS`](https://huggingface.co/microsoft/TRELLIS) family, TRELLIS.2 4B
- **This build:** FP16 redistribution of the TRELLIS.2 pipeline. Weights are not retrained here.
- **License:** MIT, per upstream.
|