Mixsmol - a vilm Collection

vilm 's Collections

Smol Pretraining

Mixsmol

updated Feb 10, 2024

Smol MoE series - in collaboration with Ontocord

vilm/Mixsmol-4x400M-v0.1-epoch1

Text Generation • 2B • Updated Jan 29, 2024 • 89 • 11
vilm/Mixsmol-4x400M-v0.1-epoch2

Text Generation • 2B • Updated Jan 30, 2024 • 88 • 5
vilm/Mixsmol-4x400M-v0.1-epoch3

Text Generation • 2B • Updated Feb 24, 2024 • 1 • 5