Article
🧠 I trained my own French LLM from scratch — alone, with a 1080 Ti, and the power went out ⚡🇫🇷
RDTvlokip
• • 5vloplok PRO
RDTvlokip
AI & ML interests
None yet
Recent Activity
posted an update 7 days ago
🧠 I trained a French LLM from scratch. Alone. On a 1080 Ti. And honestly… it was a lot.
4 months building the dataset before even touching the model. Custom crawler, custom extractor, custom BPE tokenizer, everything from zero. Then the architecture — RoPE, RMSNorm, SwiGLU, Flash Attention. Then a 3-phase trainer. Then debugging a causal mask bug that made the model generate "ïsïsïs" for hours.
Then the power went out at epoch 10/18.
The checkpoint survived. The model learned form perfectly — grammar, markdown, structure. Substance? Still working on it. Honest conclusion.
Full write-up here 👇
🔗 https://huggingface.co/blog/RDTvlokip/i-trained-my-own-french-llm-from-scratchOrganizations
upvoted 2
articles 7 days ago
Article
🧠 J'ai entraîné mon propre LLM français from scratch — seul, avec une 1080 Ti, et le courant a coupé ⚡🇫🇷
RDTvlokip
• • 2 upvoted 2
articles 2 months ago
Article
🧲 Embeddings — When AI turns words into GPS coordinates! 📍🧠
RDTvlokip
• • 1 Article
🧲 Embeddings — Quand l'IA transforme les mots en coordonnées GPS ! 📍🧠
RDTvlokip
• • 1 upvoted a changelog 2 months ago
Hugging Face Changelog
Public Storage Add-ons
• 169
upvoted 4
articles 3 months ago
Article
🎯 PCA (Principal Component Analysis) — Compresser les dimensions comme un boss ! 📊🔥
RDTvlokip
• • 1 Article
🎯 PCA (Principal Component Analysis) — Compressing dimensions like a boss! 📊🔥
RDTvlokip
• • 1 Article
🎯 K-Means — Quand l'IA organise le chaos en boîtes bien rangées ! 📦✨
RDTvlokip
• • 1 Article
🎯 K-Means — When AI organizes chaos into neat boxes! 📦✨
RDTvlokip
• • 1 upvoted 8
articles 4 months ago
Article
🎯 F1-Score — Quand l'Accuracy te ment en pleine face ! 📊💥
RDTvlokip
• • 1 Article
🎯 F1-Score — When Accuracy lies to your face! 📊💥
RDTvlokip
• • 1 Article
🎯 Precision & Recall — Les métriques jumelles qui ne sont jamais d'accord ! ⚖️🔍
RDTvlokip
• • 1 Article
🎯 Precision & Recall — The twin metrics that never agree! ⚖️🔍
RDTvlokip
• • 1 Article
🎆 AI 2026 — The 9 trends that will EXPLODE this year! 🚀💥
RDTvlokip
• • 1 Article
🎆 IA 2026 — Les 9 tendances qui vont exploser cette année ! 🚀💥
RDTvlokip
• • 2 Article
📊 Cross-Entropy — The loss function that KNOWS how to punish! 🎯🔥
RDTvlokip
• • 1 Article
📊 Cross-Entropy — La fonction de perte qui SAIT punir ! 🎯🔥
RDTvlokip
• • 2 upvoted 3
articles 5 months ago
Article
🎯 Learning Rate — L'accélérateur de ton réseau de neurones ! 🚗💨
RDTvlokip
• • 1 Article
🎯 Learning Rate — The gas pedal of your neural network! 🚗💨
RDTvlokip
• • 1 Article
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
- +4
itazap, ariG23498, ArthurZ, sergiopaniego, merve, pcuenq
• • 124