metadata
license: mit
language:
- ru
tags:
- deglm
🚀 deglm-55M
A lightweight language model with 55.5M parameters.
Technical Specifications
- Total Parameters: 55,591,424 (~55.6M)
- Vocabulary Size: 8,192
- Embedding Dimensions: 512
- Hidden Layers: 16
- Attention Heads: 8
- Head Dimension: 64
- Context Length: 512