Improve model card: Add pipeline tag, update license, and enrich content
#1
by
nielsr
HF Staff
- opened
README.md
CHANGED
|
@@ -1,5 +1,53 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
|
|
|
| 3 |
---
|
| 4 |
-
|
| 5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: cc-by-nc-4.0
|
| 3 |
+
pipeline_tag: image-to-3d
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
# Gaussian Splatting with Discretized SDF for Relightable Assets
|
| 7 |
+
|
| 8 |
+
This repository contains the official checkpoints for **DiscretizedSDF**, a novel method presented in the paper [Gaussian Splatting with Discretized SDF for Relightable Assets](https://huggingface.co/papers/2507.15629). This work will be presented at ICCV 2025.
|
| 9 |
+
|
| 10 |
+
DiscretizedSDF significantly advances 3D Gaussian splatting (3DGS) for inverse rendering, enabling the creation of high-quality relightable 3D assets. It addresses common challenges in applying geometry constraints to discrete Gaussian primitives and the high memory costs associated with continuous Signed Distance Fields (SDFs).
|
| 11 |
+
|
| 12 |
+
Key innovations include:
|
| 13 |
+
- **Discretized SDF**: A novel approach to represent continuous SDFs discretely, encoding sampled values within each Gaussian. This allows for efficient SDF rendering via splatting, bypassing costly ray tracing.
|
| 14 |
+
- **Projection-based Consistency Loss**: A unique regularization technique that projects Gaussians onto the SDF's zero-level set, ensuring geometric alignment with the splatted surface.
|
| 15 |
+
|
| 16 |
+
Thanks to these innovations, DiscretizedSDF achieves superior relighting quality without additional memory overhead compared to standard 3DGS, and it simplifies the training process by avoiding complex manual optimizations.
|
| 17 |
+
|
| 18 |
+
<p align="middle">
|
| 19 |
+
<img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/horse_golf.gif" width="30%"/><img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/angel_corridor.gif" width="30%"/><img src="https://github.com/NK-CS-ZZL/DiscretizedSDF/raw/main/demo/potion_golf.gif" width="30%"/>
|
| 20 |
+
</p>
|
| 21 |
+
|
| 22 |
+
## Links
|
| 23 |
+
- π **Paper**: [Gaussian Splatting with Discretized SDF for Relightable Assets](https://huggingface.co/papers/2507.15629)
|
| 24 |
+
- π **Project Page**: [https://nk-cs-zzl.github.io/projects/dsdf/index.html](https://nk-cs-zzl.github.io/projects/dsdf/index.html)
|
| 25 |
+
- π» **GitHub Repository**: [https://github.com/NK-CS-ZZL/DiscretizedSDF](https://github.com/NK-CS-ZZL/DiscretizedSDF)
|
| 26 |
+
|
| 27 |
+
## Usage
|
| 28 |
+
For detailed installation instructions, environment setup, and information on training and evaluation, please refer to the [official GitHub repository](https://github.com/NK-CS-ZZL/DiscretizedSDF).
|
| 29 |
+
|
| 30 |
+
To run a quick relighting video demo with the provided checkpoints:
|
| 31 |
+
|
| 32 |
+
1. Clone the repository:
|
| 33 |
+
```bash
|
| 34 |
+
git clone https://github.com/NK-CS-ZZL/DiscretizedSDF.git
|
| 35 |
+
cd DiscretizedSDF
|
| 36 |
+
```
|
| 37 |
+
2. Follow the installation steps on the [GitHub repository's "Dependencies and Installation" section](https://github.com/NK-CS-ZZL/DiscretizedSDF#dependencies-and-installation) to set up the environment and dependencies.
|
| 38 |
+
3. Download pretrained models (e.g., from [HuggingFace](https://huggingface.co/lalala125/DiscreteSDF) as mentioned in the GitHub README) and place them in the `pretrained` folder.
|
| 39 |
+
4. Run the demo script:
|
| 40 |
+
```bash
|
| 41 |
+
sh demo.sh
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## Citation
|
| 45 |
+
If you find our work useful for your research, please consider citing our paper:
|
| 46 |
+
```bibtex
|
| 47 |
+
@inproceedings{zhu_2025_dsdf,
|
| 48 |
+
title={Gaussian Splatting with Discretized SDF for Relightable Assets},
|
| 49 |
+
author={Zhu, Zuo-Liang and Yang, Jian and Wang, Beibei},
|
| 50 |
+
booktitle={Proceedings of IEEE International Conference on Computer Vision (ICCV)},
|
| 51 |
+
year={2025}
|
| 52 |
+
}
|
| 53 |
+
```
|