fromziro/Zero-TinyImage-0.6M Unconditional Image Generation โข 639k โข Updated 3 days ago โข 141 โข 7
view post Post 90 Zero-v1.0-144M is currently training. So far, it has completed 26% of its training run, with about 98 billion tokens to go.Current Val PPL: 13.705Zero-v1.0 uses a custom architecture consisting of RMSNorm, RoPe, SwiGLU, Engram Conditional Memory, mHC, and XSA GQA. See translation ๐ 1 1 ๐ 1 1 ๐ฅ 1 1 + Reply
fromziro/Zero-TinyImage-0.6M Unconditional Image Generation โข 639k โข Updated 3 days ago โข 141 โข 7
view post Post 175 Y'all, check out the new Teich distill! TeichAI/Fable-5-Cursor-Traces See translation 2 replies ยท ๐ฅ 3 3 ๐ 1 1 ๐ 1 1 + Reply
view post Post 4102 Do you support the SLM(1M-150M parameter) community?If so, join the SLM discord(https://discord.gg/BBYaERvvn), and give these orgs some follows! BananaMind SupraLabs fromziro AxiomicLabs See translation 3 replies ยท ๐ฅ 20 20 ๐ 8 8 ๐ค 7 7 ๐ 6 6 + Reply
view post Post 3313 GPT-X2.5-135M is finally released! ๐The new flagship from Axiomic Labs takes 3rd on the open SLM leaderboard trailing only the SmolLMs, check it out and follow us: AxiomicLabs/GPT-X2.5-135M See translation 2 replies ยท ๐ 14 14 ๐ฅ 6 6 ๐ค 4 4 โค๏ธ 4 4 ๐ 2 2 + Reply