Kairo GPT

From-scratch GPT-style causal LM (8 layers, 512 dim, 8 heads, 32000 BPE vocab), trained as the "brain" behind the Kairo Voice assistant.

Load with:

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("QDHShamiro/Kairo", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("QDHShamiro/Kairo")