rob PRO

rob-x-ai

https://www.kroonen.ai

AI & ML interests

∙ Open Research ∙ Making Generative AI accessible to anyone on consumer hardware

Recent Activity

upvoted a changelog 42 minutes ago

Introducing hf-mount

liked a Space 1 day ago

rob-x-ai/genesis-1b-run2-playground

updated a Space 2 days ago

rob-x-ai/genesis-1b-run2-playground

View all activity

Organizations

upvoted a changelog 42 minutes ago

Hugging Face Changelog

Introducing hf-mount

1 day ago

• 104

liked a Space 1 day ago

Genesis 1B Run 2 Playground

🔥

Generate text with a live‑training 1B‑parameter model

updated a Space 2 days ago

Genesis 1B Run 2 Playground

🔥

Generate text with a live‑training 1B‑parameter model

published a Space 2 days ago

Genesis 1B Run 2 Playground

🔥

Generate text with a live‑training 1B‑parameter model

updated a Space 2 days ago

Genesis 1b Playground

🔥

Generate text with a 1B‑parameter model

liked a dataset 2 days ago

Anthropic/hh-rlhf

Viewer • Updated May 26, 2023 • 169k • 26.2k • 1.69k

liked a dataset 4 days ago

open-index/hacker-news

Viewer • Updated 3 minutes ago • 47.5M • 9.33k • 190

posted an update 7 days ago

Post

149

Genesis 1B is now public. 🔥

I’m training a 1.003B parameter model from scratch on 2× RTX 4090s and opened a public playground for early checkpoints.

The real bottleneck wasn’t training.
It was checkpointing:

FSDP full-state gather over PCIe = NCCL timeout hell

Switching to DCP sharded checkpoints changed the trajectory of the run.

- Playground: rob-x-ai/genesis-1b-playground
- Write-up: https://kroonen.ai/blog/distributed-checkpoint-failures-rtx4090/