---
base_model: SaintsStudios/Mazgu_Small-T_130M
library_name: peft
pipeline_tag: text-generation
tags:
- base_model:adapter:SaintsStudios/Mazgu_Small-T_130M
- lora
- sft
- transformers
- trl
language:
- en
- ny
- to
- ln
- sw
- sn
- tum
- lin
license: apache-2.0
---

# Mazgu

**Mazgu** is a bilingual Large Language Model (LLM) developed by Saints Studios, specifically optimized for **Tumbuka (Tumbuka)** and **English**.

## Model Details
- **Architecture:** Llama-based architecture
- **Parameters:** ~130 Million
- **Vocabulary Size:** 32,000 tokens
- **Context Length:** 512 tokens
- **Training Data:** A curated blend of Tumbuka translated datasets (Gutenberg, TinyStories) and English Light Novels.

### Framework versions

- PEFT 0.20.0