RMSN-532M-Near-Upstream-Base

Resonant Metriplectic Sheaf Network β€” Near-Upstream Topology with Terminal Condensation Pre-trained base model (100k steps). D=1664 is the final architecture in the DuoNeural Phase 5 Topology Zoo (D=944–2048), completing the survey of RMSN soliton phases.

Architecture

Parameter Value
Hidden dim 1664
Layers 16
Workspace slots 64
Params 532.17M
Framework Port-Hamiltonian (ḟ = {f,H} + [f,S])
Tokenizer HuggingFaceTB/cosmo2-tokenizer (vocab=49152)

Soliton Topology: Near-Upstream + Terminal Condensation

Layer  PR      Role
──────────────────────────────────────────────────────
L00    18.663  Input (inert)
L01-L04 > 10  Pre-soliton buffer
L05    2.104   β˜… UPSTREAM ANCHOR SOLITON
L06    33.727  Gap (high PR β€” dielectric gap)
L07    3.425   β˜… COMPACT BULK CLUSTER (entry)
L08    2.944   β˜… COMPACT BULK CLUSTER (core)
L09    1.945   β˜… COMPACT BULK CLUSTER (exit)
L10    6.129   Near-threshold (not solitonic)
L11-L14 > 30  High-PR dielectric buffer
L15    1.000   β˜…β˜… TERMINAL BOUNDARY EXACT CONDENSATE
──────────────────────────────────────────────────────
Active soliton layers: [5, 7, 8, 9, 15]

Topological class: Near-Upstream

  • L5 upstream anchor (PR=2.104) separated from compact interior cluster by a dielectric gap at L6
  • 3-layer compact bulk waveguide [L7–L9] β€” cohesive interior soliton cluster
  • Terminal boundary singularity L15=1.000 (confirmed universal for Dβ‰₯1664 in r=0 architectures)
  • No input boundary activation (L0=18.663, inert) β€” contrasts with Dβ‰₯1792 seeds which show L0 solitonic

Terminal Condensation Law

D=1664 confirms L15=1.000 terminal boundary singularity, extending the law:

D L15 status
≀1536 (some seeds) L13 or L14=1.000 (not L15)
β‰₯1536 (seeds with L15) L15=1.000 βœ“
β‰₯1664 s1 L15=1.000 βœ“ confirmed
β‰₯1792 all seeds L15=1.000 βœ“βœ“βœ“ (fully universal)

L15=1.000 is likely universal for all r=0 architectures with Dβ‰₯1664, though multi-seed confirmation at D=1664 is pending (D=1792 confirmed across all 3 seeds).

Position in Topology Zoo

D=1664 occupies an intermediate position between D=1536 and D=1792:

  • Smaller than D=1792's bulk tube/COEXISTENCE topologies (fewer active layers)
  • Larger than D=1536's upstream-anchored conduit topologies (compact cluster, not just pointlike)
  • Near-Upstream class (also seen at D=1152 s3, shifted to later layers at D=1664)

The Near-Upstream topology at D=1664 bridges the transition between D=1536's upstream- anchored conduits and D=1792's fully developed bulk waveguide topologies.

D-Scaling Law Position

D Params Topology class Notes
1280 284M 6-Layer Bulk Tube Optimal SFT at 5k
1408 342M Triple-Singularity 3Γ— PR=1.000
1536 390M Various (seed-dependent) Transition dimension
1664 (this) 532M Near-Upstream Compact 3-layer cluster
1792 602M COEXISTENCE / Harmonic / DualBoundary Full tube development
2048 756M Triple Condensate Topological overcrowding

Quickstart

import torch
from rmsn_core import RMSNForCausalLM, RMSNConfig

config = RMSNConfig(vocab_size=49152, hidden_dim=1664, num_layers=16,
                   num_workspace_slots=64, max_seq_len=512)
model = RMSNForCausalLM(config)
ck = torch.load("model.pt", map_location="cpu")
model.load_state_dict(ck["model_state"])
model.eval()

Citation

@misc{duoneural2026rmsn,
  title={Resonant Metriplectic Sheaf Networks: Port-Hamiltonian Language Models with Soliton Waveguide Topology},
  author={DuoNeural Lab and Archon and Aura},
  year={2026},
  note={DuoNeural Phase 5e β€” Topology Zoo Complete (D=944-2048), Near-Upstream Topology at D=1664}
}

DuoNeural Lab | Phase 5e: Topology Zoo Complete | Nov 2026 Final architecture in the Phase 5 survey: D=944 through D=2048

Downloads last month
35
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support