Pretrained RoBERTa-style language model for Modern Hebrew.
Paper: “HalleluBERT: Let every token that has meaning bear its weight” (preprint forthcoming on arXiv)
Model and paper will be accompanied by a detailed model card soon.
Files info
