Hugging Face's logo

wayyresearch
/
aetheris

Text Generation
PyTorch
mamba
ssm
state-space-model
mixture-of-experts
Mixture of Experts
multilingual
distillation
knowledge-distillation
aya
hybrid-architecture
wayy-research
Model card Files
xet
Community
aetheris / stage2_metadata.json

Commit History

Update Stage 2 metadata: COMPLETE, best loss=2.7305
022db6b
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 18500/20000] loss=3.1250
bd21a1f
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 16250/20000] loss=3.1719
737dbfa
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 14050/20000] loss=3.7812
5f94915
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 13450/20000] loss=3.3594
85dfc82
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 12350/20000] loss=3.3750
c123585
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 10150/20000] loss=3.4375
758c31e
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 8500/20000] loss=3.0625
b0d9cf2
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 7350/20000] loss=3.0469
3f32ada
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 6250/20000] loss=4.3750
f34e5c6
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 5150/20000] loss=4.0312
21c956b
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 4550/20000] loss=3.7031
ef84e46
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 4000/20000] loss=4.1250
5fa4e5b
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 3400/20000] loss=3.6719
1ae5613
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 2850/20000] loss=4.2500
63908e7
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 1800/20000] loss=5.8750
827c063
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 1200/20000] loss=6.2812
727f9df
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 650/20000] loss=6.4688
8c62022
verified

rcgalbo commited on

Stage 2 checkpoint: [Step 100/20000] loss=7.5625
63f47f9
verified

rcgalbo commited on