AI & ML interests

Building stuff.

Recent Activity

Harley-mlย  updated a Space 3 days ago
fromziro/README
Harley-mlย  updated a model 3 days ago
fromziro/ZeroS-v0.1-150M
Harley-mlย  updated a model 3 days ago
fromziro/ZeroS-Linear-50M
View all activity

Harley-mlย 
updated a Space 3 days ago
Harley-mlย 
posted an update 8 days ago
view post
Post
90
Zero-v1.0-144M is currently training. So far, it has completed 26% of its training run, with about 98 billion tokens to go.

Current Val PPL: 13.705

Zero-v1.0 uses a custom architecture consisting of RMSNorm, RoPe, SwiGLU, Engram Conditional Memory, mHC, and XSA GQA.
Enderchefย 
posted an update 24 days ago
Enderchefย 
posted an update 30 days ago
Enderchefย 
posted an update about 1 month ago
view post
Post
3313
GPT-X2.5-135M is finally released! ๐Ÿš€
The new flagship from Axiomic Labs takes 3rd on the open SLM leaderboard trailing only the SmolLMs, check it out and follow us:
AxiomicLabs/GPT-X2.5-135M
  • 2 replies
ยท