SparseFlow Neural v11 (Balanced)
🧠 Balanced Neural Diversity
7 types with BALANCED distribution:
- STEM: 10% (minimum maintained)
- EXCITATORY: 35% (main carriers)
- INHIBITORY: 10% (capped, gentle)
- MEMORY: 15%
- PATTERN: 12%
- RELAY: 10%
- MODULATORY: 8% (capped)
Metrics
| Metric | Value |
|---|---|
| Params | 79,198,470 |
| PPL | 3.10 |
| Attn Sparse | 87.5% |
| FFN Sparse | 75.0% |
By Logo - Ame Web Studio