Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
wayyresearch
/
aetheris
like
2
Follow
Wayy Research Co.
2
Text Generation
PyTorch
65 languages
mamba
ssm
state-space-model
mixture-of-experts
Mixture of Experts
multilingual
distillation
knowledge-distillation
aya
hybrid-architecture
wayy-research
arxiv:
2312.00752
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
aetheris
/
stage2_metadata.json
Commit History
Update Stage 2 metadata: COMPLETE, best loss=2.7305
022db6b
verified
rcgalbo
commited on
3 days ago
Stage 2 checkpoint: [Step 18500/20000] loss=3.1250
bd21a1f
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 16250/20000] loss=3.1719
737dbfa
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 14050/20000] loss=3.7812
5f94915
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 13450/20000] loss=3.3594
85dfc82
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 12350/20000] loss=3.3750
c123585
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 10150/20000] loss=3.4375
758c31e
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 8500/20000] loss=3.0625
b0d9cf2
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 7350/20000] loss=3.0469
3f32ada
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 6250/20000] loss=4.3750
f34e5c6
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 5150/20000] loss=4.0312
21c956b
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 4550/20000] loss=3.7031
ef84e46
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 4000/20000] loss=4.1250
5fa4e5b
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 3400/20000] loss=3.6719
1ae5613
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 2850/20000] loss=4.2500
63908e7
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 1800/20000] loss=5.8750
827c063
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 1200/20000] loss=6.2812
727f9df
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 650/20000] loss=6.4688
8c62022
verified
rcgalbo
commited on
4 days ago
Stage 2 checkpoint: [Step 100/20000] loss=7.5625
63f47f9
verified
rcgalbo
commited on
4 days ago