File size: 1,049 Bytes
b802d93 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | # CRAB Language Model
CRAB is a series of compact language models designed to deliver efficient performance across different scales and resource requirements. The family includes Pico, Nano, Micro, Tiny, and Small variants, making it suitable for experimentation, lightweight deployment, and scaling research.
## Model Series
| Model | Parameters |
| --- | ---: |
| CRAB Pico | 15M |
| CRAB Nano | 33M |
| CRAB Micro | 60M |
| CRAB Tiny | 90M |
| CRAB Small | 250M |
## Repository Structure
```text
crab_language_model/
├── app.py
├── data/
├── models/
├── models_notebooks/
├── LICENSE
└── README.md
```
## Overview
The CRAB model family focuses on small, resource-aware language models:
- **Pico** and **Nano** are intended for very lightweight experiments.
- **Micro** and **Tiny** provide larger capacity while remaining efficient.
- **Small** offers the highest-capacity model in the current CRAB series.
## License
This project is licensed under the terms included in the [LICENSE](LICENSE) file.
|