---
license: apache-2.0
language:
- en
tags:
- tiny-gpt
- from-scratch
- spiceechat
pipeline_tag: text-generation
---
**Basemini** is a tiny GPT-style transformer trained from scratch on synthetic ML sentences.
For an Experiment
**Load it like any HF model**
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("SpiceeChat/Basemini", trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("SpiceeChat/Basemini", trust_remote_code=True)
```
It runs on CPU. It runs on T4. It runs on a potato.
You ask it something. It gives you a sentence with the word "transformer" in it. That's the deal.
Made with sweat, tears, and `torch_fallback=True`. Pull requests welcome. Donations not needed. Moral support accepted.
