A small Mixtral-style Mixture-of-Experts causal language model for pretraining research on a single consumer GPU.
Michael Lee
mikecovlee
·
AI & ML interests
LLM
Recent Activity
updated a collection 5 days ago
Tiny Mixtral updated a model 5 days ago
mikecovlee/tinymistral-477m published a model 5 days ago
mikecovlee/tinymistral-477mOrganizations
models 9
mikecovlee/tinymistral-477m
Text Generation • Updated • 295
mikecovlee/tinymixtral-v2.0-beta
Text Generation • Updated • 535
mikecovlee/tinymixtral-v1.1-1b
Text Generation • Updated • 1.51k
mikecovlee/tinymixtral-v1.1-0.5b
Text Generation • Updated • 540 • 1
mikecovlee/tinymixtral-v1.0
Text Generation • Updated • 516 • 1
mikecovlee/tinymixtral-it
Text Generation • Updated • 293
mikecovlee/tinymixtral
Text Generation • 0.5B • Updated • 576
mikecovlee/tinymistral-276m-it
Text Generation • Updated • 426
mikecovlee/tinymistral-276m
Text Generation • Updated • 519
datasets 0
None public yet