A newer version of the Gradio SDK is available:
6.2.0
metadata
title: PicoChat
emoji: 🤖
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.42.0
app_file: app.py
pinned: false
license: mit
short_description: PicoChat frontend.
🤖 PicoChat
A 335M parameter language model trained from scratch on a MacBook Air M2 in ~7 days.
This Space is the interactive frontend for PicoChat. The model weights are hosted separately to optimize for bandwidth and storage.
🔗 Model Weights: huggingface.co/MGow/PicoChat
📊 Model Stats
| Feature | Details |
|---|---|
| Architecture | Depth-16 GPT-style Transformer |
| Parameters | ~335M |
| Training Data | 377M tokens (FineWeb-Edu + Synthetic) |
| Hardware | MacBook Air M2 (16GB RAM) |
| Training Cost | 5kWh of electricity |
PicoChat is a "lab notebook" proof-of-concept for training capable small language models (SLMs) on consumer hardware. It can chat, solve basic math problems, and has a quirky personality.