Add model card, metadata, and links to paper/code

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +32 -1
README.md CHANGED
@@ -1 +1,32 @@
1
- Model weight of [MBD-LMs](https://arxiv.org/abs/2606.29215)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+
7
+ # Multi-Block Diffusion Language Models (MBD-LMs)
8
+
9
+ This repository contains the model weights for **Multi-Block Diffusion Language Models (MBD-LMs)**, as presented in the paper [Multi-Block Diffusion Language Models](https://arxiv.org/abs/2606.29215).
10
+
11
+ - **Project Page:** [https://sjtu-deng-lab.github.io/mbd-lms](https://sjtu-deng-lab.github.io/mbd-lms)
12
+ - **GitHub Repository:** [https://github.com/SJTU-DENG-Lab/mbd-lms](https://github.com/SJTU-DENG-Lab/mbd-lms)
13
+ - **Inference Engine:** [https://github.com/SJTU-DENG-Lab/Diffulex](https://github.com/SJTU-DENG-Lab/Diffulex)
14
+
15
+ ## Introduction
16
+
17
+ Block Diffusion Language Models (BD-LMs) improve diffusion-based text generation with KV caching and flexible-length generation. MBD-LMs extend them from Single-Block Diffusion (SingleBD) to Multi-Block Diffusion (MultiBD), where a running-set of consecutive blocks is decoded concurrently for inter-block parallelism.
18
+
19
+ By post-training BD-LMs with Multi-block Teacher Forcing (MultiTF) and utilizing an optimized decoding algorithm based on the Block Buffer mechanism, MBD-LMs translate increased decoding parallelism into significant wall-clock acceleration without sacrificing quality.
20
+
21
+ ## Citation
22
+
23
+ If you find this work useful, please cite the paper:
24
+
25
+ ```bibtex
26
+ @article{jin2026multi,
27
+ title={Multi-Block Diffusion Language Models},
28
+ author={Jin, Yijie and Xu, Jiajun and Liu, Yuxuan and Xu, Chenkai and Tu, Yi and Li, Jiajun and Tu, Dandan and Yan, Xiaohui and Yu, Kai and Liu, Pengfei and Deng, Zhijie},
29
+ journal={arXiv preprint arXiv:2606.29215},
30
+ year={2026}
31
+ }
32
+ ```