# CRAB Language Model

CRAB is a series of compact language models designed to deliver efficient performance across different scales and resource requirements. The family includes Pico, Nano, Micro, Tiny, and Small variants, making it suitable for experimentation, lightweight deployment, and scaling research.

## Model Series

| Model | Parameters |
| --- | ---: |
| CRAB Pico | 15M |
| CRAB Nano | 33M |
| CRAB Micro | 60M |
| CRAB Tiny | 90M |
| CRAB Small | 250M |

## Repository Structure

```text
crab_language_model/
├── app.py
├── data/
├── models/
├── models_notebooks/
├── LICENSE
└── README.md
```

## Overview

The CRAB model family focuses on small, resource-aware language models:

- **Pico** and **Nano** are intended for very lightweight experiments.
- **Micro** and **Tiny** provide larger capacity while remaining efficient.
- **Small** offers the highest-capacity model in the current CRAB series.

## License

This project is licensed under the terms included in the [LICENSE](LICENSE) file.