---
language:
- de
- en
license: mit
tags:
- kairo
- gpt
- from-scratch
---

# Kairo GPT

From-scratch GPT-style causal LM (8 layers, 512 dim, 8 heads, 32000 BPE vocab),
trained as the "brain" behind the Kairo Voice assistant.

Load with:

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("QDHShamiro/Kairo", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("QDHShamiro/Kairo")
```