File size: 1,690 Bytes
69e5a76 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 | ---
license: mit
library_name: transformers
pipeline_tag: text-generation
base_model: GSAI-ML/LLaDA-8B-Instruct
tags:
- reasoning
- math
- diffusion-language-model
---
# LLaDA-Instruct-JustGRPO-Math
This model is [LLaDA-8B-Instruct](https://huggingface.co/GSAI-ML/LLaDA-8B-Instruct) fine-tuned with **JustGRPO** on MATH-500.
It was introduced in the paper [The Flexibility Trap: Why Arbitrary Order Limits Reasoning Potential in Diffusion Language Models](https://huggingface.co/papers/2601.15165).
## Method
JustGRPO is a minimalist RL approach for diffusion language models. Instead of complex diffusion-specific RL adaptations, we simply treat dLLMs as autoregressive models during training and apply standard GRPO. See our paper for details.
- **Project Page:** [https://nzl-thu.github.io/the-flexibility-trap](https://nzl-thu.github.io/the-flexibility-trap)
- **Paper:** [arXiv:2601.15165](https://arxiv.org/abs/2601.15165)
- **Code:** [https://github.com/LeapLabTHU/JustGRPO](https://github.com/LeapLabTHU/JustGRPO)
## Performance
### MATH-500
| Sequence Length | 128 | 256 | 512 |
|:---:|:---:|:---:|:---:|
| **Accuracy (%)** | 39.0 | 45.1 | 45.2 |
## Usage
For generation and evaluation, please refer to our [GitHub repository](https://github.com/LeapLabTHU/JustGRPO).
## Citation
```bibtex
@article{ni2026flexibility,
title={The Flexibility Trap: Why Arbitrary Order Limits Reasoning Potential in Diffusion Language Models},
author={Ni, Zanlin and Wang, Shenzhi and Yue, Yang and Yu, Tianyu and Zhao, Weilin and Hua, Yeguo and Chen, Tianyi and Song, Jun and Yu, Cheng and Zheng, Bo and Huang, Gao},
journal={arXiv preprint arXiv:2601.15165},
year={2026}
}
```
|