Scaling Behavior of Discrete Diffusion Language Models Model checkpoints accompanying the paper "Scaling Behavior of Discrete Diffusion Language Models" (https://arxiv.org/abs/2512.10858). dvruette/gidd-unif-10b Text Generation • 10B • Updated Dec 16, 2025 • 64 • 2 dvruette/gidd-mask-3b Text Generation • 3B • Updated Dec 16, 2025 • 306 dvruette/gidd-unif-3b Text Generation • 3B • Updated Dec 16, 2025 • 712 Scaling Behavior of Discrete Diffusion Language Models Paper • 2512.10858 • Published Dec 11, 2025 • 8
Scaling Behavior of Discrete Diffusion Language Models Paper • 2512.10858 • Published Dec 11, 2025 • 8
OpenWebText BPE BPE tokenizers with vocab sizes between 1k and 131k trained on OpenWebText, as well as the pre-tokenized dataset for each of them. dvruette/openwebtext-bpe-1k Updated Dec 17, 2025 dvruette/openwebtext-bpe-2k Updated Dec 17, 2025 dvruette/openwebtext-bpe-4k Updated Dec 17, 2025 dvruette/openwebtext-bpe-8k Updated Dec 17, 2025
Generalized Interpolating Discrete Diffusion dvruette/gidd-base-p_unif-0.0 0.4B • Updated Mar 10, 2025 • 116 • 2 dvruette/gidd-base-p_unif-0.1 0.4B • Updated Mar 10, 2025 • 13 • 1 dvruette/gidd-base-p_unif-0.2 0.4B • Updated Mar 10, 2025 • 185 dvruette/gidd-small-p_unif-0.0 0.2B • Updated Mar 10, 2025 • 961
Scaling Behavior of Discrete Diffusion Language Models Model checkpoints accompanying the paper "Scaling Behavior of Discrete Diffusion Language Models" (https://arxiv.org/abs/2512.10858). dvruette/gidd-unif-10b Text Generation • 10B • Updated Dec 16, 2025 • 64 • 2 dvruette/gidd-mask-3b Text Generation • 3B • Updated Dec 16, 2025 • 306 dvruette/gidd-unif-3b Text Generation • 3B • Updated Dec 16, 2025 • 712 Scaling Behavior of Discrete Diffusion Language Models Paper • 2512.10858 • Published Dec 11, 2025 • 8
Scaling Behavior of Discrete Diffusion Language Models Paper • 2512.10858 • Published Dec 11, 2025 • 8
Generalized Interpolating Discrete Diffusion dvruette/gidd-base-p_unif-0.0 0.4B • Updated Mar 10, 2025 • 116 • 2 dvruette/gidd-base-p_unif-0.1 0.4B • Updated Mar 10, 2025 • 13 • 1 dvruette/gidd-base-p_unif-0.2 0.4B • Updated Mar 10, 2025 • 185 dvruette/gidd-small-p_unif-0.0 0.2B • Updated Mar 10, 2025 • 961
OpenWebText BPE BPE tokenizers with vocab sizes between 1k and 131k trained on OpenWebText, as well as the pre-tokenized dataset for each of them. dvruette/openwebtext-bpe-1k Updated Dec 17, 2025 dvruette/openwebtext-bpe-2k Updated Dec 17, 2025 dvruette/openwebtext-bpe-4k Updated Dec 17, 2025 dvruette/openwebtext-bpe-8k Updated Dec 17, 2025
