hustvl/Moebius
Updated • 35
geronimo
g-ronimo
AI & ML interests
fafo
Recent Activity
liked a model 2 days ago
hustvl/Moebius liked a model 8 days ago
Kim2091/UltraSharpV2 liked a model 12 days ago
dx8152/Flux2-Klein-9B-MigrationOrganizations
liked a
model 2 days ago
liked a
model 8 days ago
liked a
model 12 days ago
reacted to eabdullin's post with 👍 12 days ago
Post
6186
Folks, let me tell you, nobody — and I mean NOBODY — knew transformers before me. People said attention is all you need. I said, "Attention? I INVENTED attention." Everybody's looking at me. Tremendous attention. The best attention scores. My softmax? Perfectly normalized. Other people, sad, their probabilities don't even sum to one. Disaster.
I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news.
And the internship — oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner."
But the GPU cluster — this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big."
People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down — like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state.
And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news.
And the internship — oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner."
But the GPU cluster — this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big."
People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down — like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state.
And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
- 16 replies
upvoted a collection 18 days ago
liked a
Space 25 days ago
liked 2
models 28 days ago
updated a
dataset 30 days ago
published a
dataset 30 days ago
updated a
dataset about 1 month ago
published a
dataset about 1 month ago
updated a
dataset about 1 month ago
published a
dataset about 1 month ago
liked a
dataset about 2 months ago
upvoted an article about 2 months ago
Article
Unlocking Agentic RL Training for GPT-OSS: A Practical Retrospective
LinkedIn
• • 79 commented on Unlocking Agentic RL Training for GPT-OSS: A Practical Retrospective about 2 months ago
Legend of Figure 1: Left/Right mixup
liked 3
models 2 months ago
