File size: 1,003 Bytes
becbb55 e108963 491d2ed becbb55 e108963 becbb55 491d2ed |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 |
---
title: PicoChat
emoji: 🤖
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.42.0
app_file: app.py
pinned: false
license: mit
short_description: PicoChat frontend.
---
# 🤖 PicoChat
> A 335M parameter language model trained from scratch on a MacBook Air M2 in ~7 days.
This Space is the interactive frontend for **PicoChat**. The model weights are hosted separately to optimize for bandwidth and storage.
🔗 **Model Weights:** [huggingface.co/MGow/PicoChat](https://huggingface.co/MGow/PicoChat)
## 📊 Model Stats
| Feature | Details |
| :--- | :--- |
| **Architecture** | Depth-16 GPT-style Transformer |
| **Parameters** | ~335M |
| **Training Data** | 377M tokens (FineWeb-Edu + Synthetic) |
| **Hardware** | MacBook Air M2 (16GB RAM) |
| **Training Cost** | 5kWh of electricity |
**PicoChat** is a "lab notebook" proof-of-concept for training capable small language models (SLMs) on consumer hardware. It can chat, solve basic math problems, and has a quirky personality.
|