Post
63
Hello everyone! 👋
A small SmilyAI Labs update!
G1-MINI has now seen around 8B tokens during its current run, and pretraining is still going strong.
Our E1 (Efficiency-1) prototype has also reached 15B pretraining tokens. E1 has 1B total parameters while activating under 100M parameters per token. It features adaptive activation, meaning easier tokens can use less compute while harder tokens receive more.
We plan to open-source E1 ASAP! 🚀
We’re also excited to announce Project Prism, which will provide limited access to our upcoming Orion Flagship model, powered by our T2 architecture.
Note: T2 here refers to the architecture, not our T2 (Thinker-2) model.
Applications for Project Prism are available through the org page, with more details coming soon!
Finally, welcome @soyL061215 , who joined the Hugging Face org today! 🎉
Thanks to our existing members:
@smilyai-large-team @MUK-IS-GOAT @Keeby-smilyai @Bc-AI
— Bc-AI
SmilyAI Labs
A small SmilyAI Labs update!
G1-MINI has now seen around 8B tokens during its current run, and pretraining is still going strong.
Our E1 (Efficiency-1) prototype has also reached 15B pretraining tokens. E1 has 1B total parameters while activating under 100M parameters per token. It features adaptive activation, meaning easier tokens can use less compute while harder tokens receive more.
We plan to open-source E1 ASAP! 🚀
We’re also excited to announce Project Prism, which will provide limited access to our upcoming Orion Flagship model, powered by our T2 architecture.
Note: T2 here refers to the architecture, not our T2 (Thinker-2) model.
Applications for Project Prism are available through the org page, with more details coming soon!
Finally, welcome @soyL061215 , who joined the Hugging Face org today! 🎉
Thanks to our existing members:
@smilyai-large-team @MUK-IS-GOAT @Keeby-smilyai @Bc-AI
— Bc-AI
SmilyAI Labs
