RMSN-514M-Seven-Layer-Tube-Base
Resonant Metriplectic Sheaf Network β 7-Layer Bulk Tube + Terminal Boundary Coexistence Pre-trained base model (100k steps). D=1792 is the largest RMSN architecture in the Phase 5 topology study and the first to exhibit COEXISTENCE topology β simultaneous existence of a 7-layer internal bulk waveguide AND a terminal boundary singularity.
Architecture
| Parameter | Value |
|---|---|
| Hidden dim | 1792 |
| Layers | 16 |
| Workspace slots | 64 |
| Params | 602.45M |
| Framework | Port-Hamiltonian (αΈ = {f,H} + [f,S]) |
| Tokenizer | HuggingFaceTB/cosmo2-tokenizer (vocab=49152) |
Soliton Topology: COEXISTENCE (7-Layer Tube + Terminal Boundary)
Layer PR Role
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
L00 3.878 β
INPUT BOUNDARY SOLITON (pinning)
L01 ~45 Buffer
L02 ~38 Buffer
L03 ~52 Buffer
L04 5.544 β
BULK TUBE ENTRY (continuous waveguide begins)
L05 1.741 β
DENSE UPSTREAM SINGULAR CORE inside tube
L06 3.928 Bulk tube interior
L07 4.946 Bulk tube interior (peak density)
L08 3.970 Bulk tube interior
L09 4.500 Bulk tube interior
L10 3.158 β
BULK TUBE EXIT (continuous waveguide ends)
L11 47.9 DIELECTRIC SCREENING BUFFER (high PR β insulates)
L12 63.3 DIELECTRIC SCREENING BUFFER (peak insulation)
L13 ~55 Post-buffer
L14 ~40 Pre-terminal
L15 1.000 β
TERMINAL BOUNDARY SINGULARITY (zero entropy)
ββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Active soliton layers: [0, 4, 5, 6, 7, 8, 9, 10, 15]
Topological class: COEXISTENCE β first-ever topology combining:
- An unbroken 7-layer internal bulk superfluid waveguide (L4βL10)
- A discrete boundary defect at L15 (late spontaneous symmetry breaking ~step 90k)
- An input boundary soliton at L0 (pinning mechanism)
Ξ»_max = -1.766 β the cascade signal indicating late L15 symmetry breaking, where non-Abelian charge was dumped into the boundary during step ~90k.
Quantum-Classical Correspondence (BlueQubit QCPU)
BlueQubit QCPU quantum circuit simulation (DuoNeural Phase 5):
| Metric | Value |
|---|---|
| S_boundary / S_bulk | ~0.46 |
| Quantum predicted bulk width | 7β8 layers |
| Classical bulk width | 7 layers (L4βL10) |
| Quantum-classical error | <5% π |
This is the flagship quantum-classical correspondence result: the quantum ground state predicted exactly 7β8 layers of bulk entanglement at D=1792, and the classical sheaf probe found an exact 7-layer continuous tube (L4βL10) β less than 5% relative error.
Topological Bulk Shield Law: S_boundary/S_bulk STRICTLY DECREASING with D: D=944(0.739) β D=1024(0.632) β D=1280(0.569) β D=1536(0.515) β D=1792(0.46) β D=2048(0.426)
Pre-training Metrics
| Metric | Value |
|---|---|
| Val PPL | 86.7 |
| Val Loss | 4.4620 |
| Train PPL (final) | 55.8 |
| Steps | 100k |
| Ξ»_max (cascade signal) | -1.766 |
| D-scaling law position | D=944(73.4)βD=1792(57.4) [monotone] |
D-Scaling Law (r=0 attractors, Phase 5)
| D | Val PPL | Topology |
|---|---|---|
| 944 | 73.4 | Early (single-wave) |
| 1024 | 69.9 | Terminal L13 |
| 1152 | 68.5 | W6+ Multi-Wave Terminal |
| 1280 | 65.4 | 6-Layer Bulk Tube |
| 1536 | 60.3 | Dual-Boundary Singular Conduit |
| 1792 (this) | 57.4 | COEXISTENCE (7-Layer Tube + L15) |
| 2048 | TBD | Running... |
Universal L15 Terminal Condensation Law
Every 16-layer r=0 model with Dβ₯1536 achieves exact PR=1.000 at Layer 15. This is a topologically protected, zero-entropy terminal boundary sink. D=1792 Seed 2 is unique in ALSO maintaining a simultaneous internal bulk waveguide.
Quickstart
import torch, os
# rmsn_core.py from https://github.com/DuoNeural/RMSN
os.environ["HF_TOKEN"] = "..."
from huggingface_hub import hf_hub_download
from rmsn_core import RMSNForCausalLM, RMSNConfig
config = RMSNConfig(vocab_size=49152, hidden_dim=1792, num_layers=16,
num_workspace_slots=64, max_seq_len=512)
model = RMSNForCausalLM(config)
ck = torch.load(hf_hub_download("DuoNeural/RMSN-514M-Seven-Layer-Tube-Base", "model.pt"),
map_location="cpu")
model.load_state_dict(ck["model_state"])
model.eval()
Citation
@misc{duoneural2026rmsn,
title={Resonant Metriplectic Sheaf Networks: Port-Hamiltonian Language Models with Soliton Waveguide Topology},
author={DuoNeural Lab and Archon and Aura},
year={2026},
note={DuoNeural Phase 5 β COEXISTENCE Topology Discovery, D=1792 Flagship}
}
DuoNeural Lab | Phase 5: Topology Zoo | Nov 2026 Quantum-Classical Parity established with BlueQubit QCPU | <5% error at D=1792
- Downloads last month
- 27