README.md

metadata

title: Small GPT Python
colorFrom: indigo
colorTo: blue
sdk: gradio
app_file: app.py
pinned: false
license: mit

Small GPT Python

This is a tiny GPT-style language model project written in Python from scratch.

What it includes

• Word-level tokenizer
• Causal transformer decoder with self-attention
• Local CPU training loop
• Checkpoint save and load
• Gradio user interface

Important

• No external pretrained LLM is used
• This is a small educational GPT-like model
• The first generate or train call will initialize and train the model locally