Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
+ # GDSD: Guided Denoiser Self-Distillation for Diffusion Language Models
7
+
8
+ This repository contains a model checkpoint from the paper [GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models](https://huggingface.co/papers/2605.29398).
9
+
10
+ Guided Denoiser Self-Distillation (GDSD) is a reinforcement learning framework that improves the denoiser of diffusion large language models (dLLMs) by distilling from an advantage-guided self-teacher. This approach bypasses the biases of traditional ELBO-based methods and provides more stable training dynamics for dLLMs across planning, math, and coding benchmarks.
11
+
12
+ ## Links
13
+
14
+ - **Paper**: [https://arxiv.org/abs/2605.29398](https://arxiv.org/abs/2605.29398)
15
+ - **Code**: [https://github.com/GaryBall/GDSD](https://github.com/GaryBall/GDSD)
16
+
17
+ ## Citation
18
+
19
+ If you find GDSD helpful, please consider citing:
20
+
21
+ ```bibtex
22
+ @misc{tang2026gdsdreinforcementlearningguided,
23
+ title={GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models},
24
+ author={Xiaohang Tang and Keyue Jiang and Che Liu and Qifang Zhao and Xiaoxiao Xu and Sangwoong Yoon and Ilija Bogunovic},
25
+ year={2026},
26
+ eprint={2605.29398},
27
+ archivePrefix={arXiv},
28
+ primaryClass={cs.LG},
29
+ url={https://arxiv.org/abs/2605.29398},
30
+ }
31
+ ```