How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("fill-mask", model="tommyp111/modernbert-diffusion")
# Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM

tokenizer = AutoTokenizer.from_pretrained("tommyp111/modernbert-diffusion")
model = AutoModelForMaskedLM.from_pretrained("tommyp111/modernbert-diffusion", device_map="auto")
Quick Links

ModernBERT finetune as a diffusion llm -- see https://arxiv.org/abs/2502.09992

Downloads last month
3
Safetensors
Model size
0.4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including tommyp111/modernbert-diffusion

Paper for tommyp111/modernbert-diffusion