RMSN-532M-Near-Upstream-Base
Resonant Metriplectic Sheaf Network β Near-Upstream Topology with Terminal Condensation Pre-trained base model (100k steps). D=1664 is the final architecture in the DuoNeural Phase 5 Topology Zoo (D=944β2048), completing the survey of RMSN soliton phases.
Architecture
| Parameter | Value |
|---|---|
| Hidden dim | 1664 |
| Layers | 16 |
| Workspace slots | 64 |
| Params | 532.17M |
| Framework | Port-Hamiltonian (αΈ = {f,H} + [f,S]) |
| Tokenizer | HuggingFaceTB/cosmo2-tokenizer (vocab=49152) |
Soliton Topology: Near-Upstream + Terminal Condensation
Layer PR Role
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
L00 18.663 Input (inert)
L01-L04 > 10 Pre-soliton buffer
L05 2.104 β
UPSTREAM ANCHOR SOLITON
L06 33.727 Gap (high PR β dielectric gap)
L07 3.425 β
COMPACT BULK CLUSTER (entry)
L08 2.944 β
COMPACT BULK CLUSTER (core)
L09 1.945 β
COMPACT BULK CLUSTER (exit)
L10 6.129 Near-threshold (not solitonic)
L11-L14 > 30 High-PR dielectric buffer
L15 1.000 β
β
TERMINAL BOUNDARY EXACT CONDENSATE
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Active soliton layers: [5, 7, 8, 9, 15]
Topological class: Near-Upstream
- L5 upstream anchor (PR=2.104) separated from compact interior cluster by a dielectric gap at L6
- 3-layer compact bulk waveguide [L7βL9] β cohesive interior soliton cluster
- Terminal boundary singularity L15=1.000 (confirmed universal for Dβ₯1664 in r=0 architectures)
- No input boundary activation (L0=18.663, inert) β contrasts with Dβ₯1792 seeds which show L0 solitonic
Terminal Condensation Law
D=1664 confirms L15=1.000 terminal boundary singularity, extending the law:
| D | L15 status |
|---|---|
| β€1536 (some seeds) | L13 or L14=1.000 (not L15) |
| β₯1536 (seeds with L15) | L15=1.000 β |
| β₯1664 s1 | L15=1.000 β confirmed |
| β₯1792 all seeds | L15=1.000 βββ (fully universal) |
L15=1.000 is likely universal for all r=0 architectures with Dβ₯1664, though multi-seed confirmation at D=1664 is pending (D=1792 confirmed across all 3 seeds).
Position in Topology Zoo
D=1664 occupies an intermediate position between D=1536 and D=1792:
- Smaller than D=1792's bulk tube/COEXISTENCE topologies (fewer active layers)
- Larger than D=1536's upstream-anchored conduit topologies (compact cluster, not just pointlike)
- Near-Upstream class (also seen at D=1152 s3, shifted to later layers at D=1664)
The Near-Upstream topology at D=1664 bridges the transition between D=1536's upstream- anchored conduits and D=1792's fully developed bulk waveguide topologies.
D-Scaling Law Position
| D | Params | Topology class | Notes |
|---|---|---|---|
| 1280 | 284M | 6-Layer Bulk Tube | Optimal SFT at 5k |
| 1408 | 342M | Triple-Singularity | 3Γ PR=1.000 |
| 1536 | 390M | Various (seed-dependent) | Transition dimension |
| 1664 (this) | 532M | Near-Upstream | Compact 3-layer cluster |
| 1792 | 602M | COEXISTENCE / Harmonic / DualBoundary | Full tube development |
| 2048 | 756M | Triple Condensate | Topological overcrowding |
Quickstart
import torch
from rmsn_core import RMSNForCausalLM, RMSNConfig
config = RMSNConfig(vocab_size=49152, hidden_dim=1664, num_layers=16,
num_workspace_slots=64, max_seq_len=512)
model = RMSNForCausalLM(config)
ck = torch.load("model.pt", map_location="cpu")
model.load_state_dict(ck["model_state"])
model.eval()
Citation
@misc{duoneural2026rmsn,
title={Resonant Metriplectic Sheaf Networks: Port-Hamiltonian Language Models with Soliton Waveguide Topology},
author={DuoNeural Lab and Archon and Aura},
year={2026},
note={DuoNeural Phase 5e β Topology Zoo Complete (D=944-2048), Near-Upstream Topology at D=1664}
}
DuoNeural Lab | Phase 5e: Topology Zoo Complete | Nov 2026 Final architecture in the Phase 5 survey: D=944 through D=2048
- Downloads last month
- 35