| license: mit | |
| language: | |
| - ru | |
| tags: | |
| - deglm | |
| # 🚀 deglm-55M | |
| A lightweight language model with **55.5M parameters**. | |
| ### Technical Specifications | |
| * **Total Parameters:** 55,591,424 (~55.6M) | |
| * **Vocabulary Size:** 8,192 | |
| * **Embedding Dimensions:** 512 | |
| * **Hidden Layers:** 16 | |
| * **Attention Heads:** 8 | |
| * **Head Dimension:** 64 | |
| * **Context Length:** 512 |