SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code
Abstract
The rapid growth of 3D Gaussian Splatting (3DGS) research demands significant effort to reimplement papers before building on them. We introduce SPLATIFY, a multi-agent framework that converts 3DGS papers into trainable gsplat-based implementations, where generic paper-to-code methods and frontier models fail. SPLATIFY achieves this through five innovations: (1) A context-free grammar for gsplat over a modular method template with extension points for losses, densification, rendering, and optimization, constraining synthesis so generated code satisfies gsplat's architectural invariants by construction. (2) Architectural elements for faithful reproduction: fork-aware citation recovery retrieving component-level code at function-level granularity, Graph-of-Thought synthesis in topological dependency order, RAG-guided in-context example selection from over 20 verified implementations, and visual feedback combining PSNR-guided regeneration, Gaussian-level structural checks, and VLM-driven patching. (3) Knowledge-driven compositional improvement that autonomously finds weaknesses and composes complementary regularizers, losses, and densification strategies to improve upon original results. (4) Interdisciplinary method discovery where agents retrieve physical priors from outside the 3DGS literature and compose them with rendering knowledge to produce methods for previously unaddressed scene types. (5) SPLATIFY-Bench, an evaluation framework across 30 diverse 3DGS papers. On papers without public code, SPLATIFY matches expert implementations while reducing development time from weeks to minutes, and through compositional discovery further improves PSNR by up to 2.4 dB. We additionally demonstrate novel methods for volumetric nebula rendering and other scientific domains, synthesized entirely by SPLATIFY.
Community
Hi Hugging Face community! I’m one of the authors of SPLATIFY, a multi-agent framework that turns 3D Gaussian Splatting research papers into trainable code - and then builds beyond them. arXiv
Our goal is to connect three steps of the research process:
🛠️ Reproduce: Convert papers into trainable gsplat implementations, including methods without publicly available code. In our experiments, SPLATIFY produces implementations comparable to expert-written references, reducing implementation time from weeks to minutes.
🔍 Discover: Diagnose weaknesses and combine complementary techniques from different papers, achieving up to +2.4 dB PSNR over reproduction-only baselines in our evaluated settings.
💡 Innovate: Retrieve physical priors beyond the 3DGS literature to synthesize methods for new applications, demonstrated through volumetric nebula rendering and thin-film bubble iridescence.
Under the hood, SPLATIFY combines grammar-constrained code generation, fork-aware dependency recovery, and closed-loop visual feedback. We introduce SPLATIFY-Bench, covering 30 papers, to evaluate reproduction and preservation of technical contributions.
We’d love feedback from researchers working on Gaussian Splatting, coding agents, and automated scientific discovery. What paper or combination of techniques would you like a system like this to implement?
Get this paper in your agent:
hf papers read 2610.09116 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper