Typed decision models from 0.8B to 27B. Every question comes back with a probability for each option.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
View all PapersOfficial PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models.
-
startlux-models/gdn-340m-pas-fa-layer04-10b
Text Generation • 0.4B • Updated • 46 -
startlux-models/gdn-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 56 -
startlux-models/gdn-340m-pas-fa-layer20-10b
Text Generation • 0.4B • Updated • 47 -
startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 41
Typed decision models from 0.8B to 27B. Every question comes back with a probability for each option.
Official PAS, ISP, gating-ablation, and scale-study checkpoints for Massive Activations in Hybrid Linear Attention Models.
-
startlux-models/gdn-340m-pas-fa-layer04-10b
Text Generation • 0.4B • Updated • 46 -
startlux-models/gdn-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 56 -
startlux-models/gdn-340m-pas-fa-layer20-10b
Text Generation • 0.4B • Updated • 47 -
startlux-models/gdn-nooutgate-340m-pas-fa-layer12-10b
Text Generation • 0.4B • Updated • 41