YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

πŸ”₯ Prometheus

Prometheus stole fire from the gods and gave it to humanity. I'm taking AI from corporations and giving it to everyone.

The Story

My name is Ali. I have no GPU. No money. No team. Just a phone and Google Colab.

I decided to build my own AI from scratch. Not a fine-tune. Not a wrapper. My own architecture. My own training. My own weights.

This is Prometheus. My creation.

Current Status

Version: v0.0 β€” just born Parameters: 25M Steps: ~5000 Loss: ~10.0 (falling every day) Hardware: Google Colab T4 (free) Data: Russian Wikipedia (streaming)

The Roadmap

v0.1 β†’ 25M β€” learning language (now) v0.2 β†’ 85M β€” simple dialogue v0.3 β†’ 300M β€” GPT-2 level v1.0 β†’ 1B β€” real assistant v2.0 β†’ 10B β€” MoE, 5 experts v4.0 β†’ 60B β€” DeepSeek level

Why?

Because I believe one person with determination can build what corporations build with millions.

Follow the journey. Watch Prometheus grow.

Updates every month.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Space using MoEprometheus/Prometheus-base 1