CRAB Language Model
CRAB is a series of compact language models designed to deliver efficient performance across different scales and resource requirements. The family includes Pico, Nano, Micro, Tiny, and Small variants, making it suitable for experimentation, lightweight deployment, and scaling research.
Model Series
| Model | Parameters |
|---|---|
| CRAB Pico | 15M |
| CRAB Nano | 33M |
| CRAB Micro | 60M |
| CRAB Tiny | 90M |
| CRAB Small | 250M |
Repository Structure
crab_language_model/
├── app.py
├── data/
├── models/
├── models_notebooks/
├── LICENSE
└── README.md
Overview
The CRAB model family focuses on small, resource-aware language models:
- Pico and Nano are intended for very lightweight experiments.
- Micro and Tiny provide larger capacity while remaining efficient.
- Small offers the highest-capacity model in the current CRAB series.
License
This project is licensed under the terms included in the LICENSE file.