File size: 1,013 Bytes
b617e6a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | # π₯ Prometheus
> *Prometheus stole fire from the gods and gave it to humanity.*
> *I'm taking AI from corporations and giving it to everyone.*
## The Story
My name is Ali.
I have no GPU. No money. No team.
Just a phone and Google Colab.
I decided to build my own AI from scratch.
Not a fine-tune. Not a wrapper.
My own architecture. My own training. My own weights.
This is Prometheus. My creation.
## Current Status
Version: v0.0 β just born
Parameters: 25M
Steps: ~5000
Loss: ~10.0 (falling every day)
Hardware: Google Colab T4 (free)
Data: Russian Wikipedia (streaming)
## The Roadmap
v0.1 β 25M β learning language (now)
v0.2 β 85M β simple dialogue
v0.3 β 300M β GPT-2 level
v1.0 β 1B β real assistant
v2.0 β 10B β MoE, 5 experts
v4.0 β 60B β DeepSeek level
## Why?
Because I believe one person with determination
can build what corporations build with millions.
Follow the journey. Watch Prometheus grow.
**Updates every month.** |