File size: 1,013 Bytes
b617e6a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
# πŸ”₯ Prometheus

> *Prometheus stole fire from the gods and gave it to humanity.*
> *I'm taking AI from corporations and giving it to everyone.*

## The Story

My name is Ali.
I have no GPU. No money. No team.
Just a phone and Google Colab.

I decided to build my own AI from scratch.
Not a fine-tune. Not a wrapper.
My own architecture. My own training. My own weights.

This is Prometheus. My creation.

## Current Status
Version:    v0.0 β€” just born
Parameters: 25M
Steps:      ~5000
Loss:       ~10.0 (falling every day)
Hardware:   Google Colab T4 (free)
Data:       Russian Wikipedia (streaming)
## The Roadmap
v0.1  β†’ 25M   β€” learning language (now)
v0.2  β†’ 85M   β€” simple dialogue
v0.3  β†’ 300M  β€” GPT-2 level
v1.0  β†’ 1B    β€” real assistant
v2.0  β†’ 10B   β€” MoE, 5 experts
v4.0  β†’ 60B   β€” DeepSeek level
## Why?

Because I believe one person with determination
can build what corporations build with millions.

Follow the journey. Watch Prometheus grow.

**Updates every month.**