| qwen2.5-0.5b_english_wiki |
Trained from scratch with 5B english tokens from Wikipedia |
| qwen2.5-0.5b_english_wiki_irish_corpus_custom_sampler |
CPT from qwen2.5-0.5b_english_wiki with 1.5B Irish tokens |
| qwen2.5-0.5b_english_wiki_1.5B_basque_corpus |
CPT from qwen2.5-0.5b_english_wiki with 1.5B Basque tokens |
| qwen2.5-0.5b_english_wiki_1_5B_stackexchange_corpus |
CPT from qwen2.5-0.5b_english_wiki with 1.5B English tokens from Stackexchange |
| qwen2.5-0.5b_english_wiki_300M_en_1.5Birish_corpus |
CPT from qwen2.5-0.5b_english_wiki with 300M English tokens and 1.5B Irish tokens |
| qwen2.5-0.5b_english_wiki_300M_en_1.5Bbasque_corpus |
CPT from qwen2.5-0.5b_english_wiki with 300M English tokens and 1.5B Basque tokens |
