Obfuscated ModernBERT - a DanielGallagherIRE Collection

DanielGallagherIRE 's Collections

Obfuscated FineWeb Edu

Obfuscated ModernBERT

CORAL Mutual Information Obfuscation (OLD)

CORAL Structural Obfuscation (OLD)

Obfuscated ModernBERT

updated about 17 hours ago

Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.

DanielGallagherIRE/ModernBERT-FWEdu-Muon

0.2B • Updated 17 days ago • 42
DanielGallagherIRE/ModernBERT-FwEdu-Baseline

0.2B • Updated 1 day ago
TiME: Tiny Monolingual Encoders for Efficient NLP Pipelines

Paper • 2512.14645 • Published Dec 16, 2025 • 1