HiTZ
/

BERnaT-large

@@ -10,6 +10,7 @@ Submitted to LREC 2026
 ## Model Description
 BERnaT is a family of monolingual Basque encoder-only language models trained to better represent linguistic variation—including standard, dialectal, historical, and informal Basque—rather than focusing solely on standard textual corpora. Models were trained on corpora that combine high-quality standard Basque with varied sources such as social media and historical texts, aiming to enhance robustness and generalization across natural language understanding (NLU) tasks.
 **Model Types**: Encoder-only Transformer models (RoBERTa-style)
 **Languages**: Basque (Euskara)

 ## Model Description
 BERnaT is a family of monolingual Basque encoder-only language models trained to better represent linguistic variation—including standard, dialectal, historical, and informal Basque—rather than focusing solely on standard textual corpora. Models were trained on corpora that combine high-quality standard Basque with varied sources such as social media and historical texts, aiming to enhance robustness and generalization across natural language understanding (NLU) tasks.
 **Model Types**: Encoder-only Transformer models (RoBERTa-style)
 **Languages**: Basque (Euskara)