---
title: Small GPT Python
colorFrom: indigo
colorTo: blue
sdk: gradio
app_file: app.py
pinned: false
license: mit
---

# Small GPT Python

This is a tiny GPT-style language model project written in Python from scratch.

## What it includes

- Word-level tokenizer
- Causal transformer decoder with self-attention
- Local CPU training loop
- Checkpoint save and load
- Gradio user interface

## Important

- No external pretrained LLM is used
- This is a small educational GPT-like model
- The first generate or train call will initialize and train the model locally