---
license: mit
library_name: transformers
pipeline_tag: text-generation
---

# LLaDA-8B-Base

This repository contains the LLaDA-8B-Base model, as described in the paper [Large Language Diffusion Models](https://hf.co/papers/2502.09992). LLaDA is a diffusion model with an 8B scale, trained entirely from scratch.

For code, see the project's GitHub repository: [ML-GSAI/SMDM](https://github.com/ML-GSAI/SMDM)

[Project Page](https://ml-gsai.github.io/LLaDA-demo/)