Hugging Face's logo

Hexa09
/
Hexa-2b-prototype

Text Generation
PyTorch
English
student-startup
zero-to-one
nef
solo-developer
bangladesh-ai
2b-parameters
Model card Files
xet
 Community
Hexa09 commited on
Commit
82fa9fe
·
verified ·
1 Parent(s): 3dbcac5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -49,7 +49,7 @@ NEF is a custom serialization framework built from scratch to replace the overhe
49
 
50
  | Property | Detail |
51
  |---|---|
52
- | Architecture | HexaDense (Transformer Decoder) |
53
  | Parameters | 2 Billion (0.27B active via MoE) |
54
  | Serialization | NEF (Neural Essence Format) |
55
  | Training hardware | Dual NVIDIA Tesla T4 (cloud compute credits) |
 
49
 
50
  | Property | Detail |
51
  |---|---|
52
+ | Architecture | Mixture OF Expart (Transformer Decoder) |
53
  | Parameters | 2 Billion (0.27B active via MoE) |
54
  | Serialization | NEF (Neural Essence Format) |
55
  | Training hardware | Dual NVIDIA Tesla T4 (cloud compute credits) |