File size: 518 Bytes
4e50e23 034ad57 394a5b9 4e50e23 d2012dd bd25488 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
license: mit
tags:
- debil
datasets:
- roneneldan/TinyStories
- yahma/alpaca-cleaned
---
# 🚀 debil-1.5
A lightweight language model with **46.5M parameters**.
### Technical Specifications:
* **Total Parameters:** 46,538,400 (~46.5M)
* **Vocabulary Size:** 50,257
* **Embedding Dimensions:** 480
* **Hidden Layers:** 8
* **Attention Heads:** 8
* **Head Dimension:** 60
### Benchmark Results:
 |