Post
246
Here is the post on Muon optimizer. It's getting hard core. I tried to visualize orthogonalization but decided to drop it to avoid miscommunication.
https://huggingface.co/blog/onekq/muon-optimizer
No matter which angle I take, I can't detect slowdown. It's the opposite in fact.
https://huggingface.co/blog/onekq/muon-optimizer
No matter which angle I take, I can't detect slowdown. It's the opposite in fact.