--- license: apache-2.0 pipeline_tag: image-to-3d --- # Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstruction This repository presents **DiffusionGS**, a novel single-stage 3D diffusion model for object generation and scene reconstruction from a single view, as described in the paper: [**Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstruction**](https://huggingface.co/papers/2411.14384) DiffusionGS directly outputs 3D Gaussian point clouds at each timestep to enforce view consistency and allows the model to generate robustly given prompt views of any direction, beyond object-centric inputs. It boasts over 5x faster speed (~6s on an A100 GPU) compared to state-of-the-art methods. - **Project Page:** https://caiyuanhao1998.github.io/project/DiffusionGS/ - **Code:** https://github.com/caiyuanhao1998/Open-DiffusionGS ## Visual Examples

Object Generation Gaussian Splatting Object Real Image Reconstruction In the Wild Scene

Scene Diffusion 2 Scene Diffusion 1 Flux 1 Green Man

Plaza Scene Town Scene

## Quick Demo For object-centric image-to-3D generation model, we provide a single-line script to use the code: ```shell python run.py ``` This code will automatically download the model checkpoints and config files from [HuggingFace](). Or you can manually download it from [this link](https://huggingface.co/coast01/LVSM/tree/main) and set it to local dir. For detailed instructions on installation, data preparation, evaluation, and training, please refer to the official [GitHub repository](https://github.com/caiyuanhao1998/Open-DiffusionGS). ## Citation If you find our work useful, please consider citing our paper: ```bibtex @inproceedings{diffusiongs, title={Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstruction}, author={Yuanhao Cai and He Zhang and Kai Zhang and Yixun Liang and Mengwei Ren and Fujun Luan and Qing Liu and Soo Ye Kim and Jianming Zhang and Zhifei Zhang and Yuqian Zhou and Yulun Zhang and Xiaokang Yang and Zhe Lin and Alan Yuille}, booktitle={ICCV}, year={2025} } ```