ModernBERT Pretrained Model Phase 2

This model was pretrained using the MosaicML Composer framework. Tokenizer used: modernBERT-base Initialised from latest stable checkpoint of modernBERT-base model: checkpoints/context-extension/ep0-ba52988-rank0.pt

Downloads last month
3
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support