YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
PHANTOM PolarisModule — Expert Checkpoints
9 specialized PolarisModule experts (14.5M params each, NoctusLayer + byte-level transformer).
Experts
| File | Domain | Lang | Loss |
|---|---|---|---|
experts/polaris_astro_cz.pt |
Astronomy | CS | 2.57 |
experts/polaris_dialog_cz.pt |
Conversation | CS | 1.96 |
experts/polaris_news_cz.pt |
News | CS | 2.53 |
experts/polaris_legal_cz.pt |
Legal | CS | 2.48 |
experts/polaris_jwst_en.pt |
JWST/Space | EN | 2.59 |
experts/polaris_science_en.pt |
Science | EN | 2.67 |
experts/polaris_creative_cz.pt |
Literature | CS | - |
experts/polaris_helix_emo.pt |
Emotion (HELIX-9) | CS | - |
experts/polaris_nexus_int.pt |
Multilingual | CS+EN | - |
Architecture
- ByteEmbed: byte-level (0–255), d=512, pos=2048
- TransformerEncoder: 4 layers, 8 heads, FFN=2048, GELU, norm_first
- NoctusLayer: bipolar (tanh) + lateral inhibition (Conv1d grouped) + gating
- LM Head: 512→259 logits
MoE
See polaris_moe_v1.pt for the consolidated MoE model (top-2 router, 9 experts).
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support