metadata
license: mit
library_name: transformers
pipeline_tag: text-generation
base_model:
- meta-llama/Meta-Llama-3-8B
LLaDA-8B-Instruct
We introduce LLaDA, a diffusion model with an unprecedented 8B scale, trained entirely from scratch, rivaling LLaMA3 8B in performance.
Updates
[2025-10-21] We have modified modeling_llada.py to support the input of attention_mask.