WYRM v27 FINAL — locked training version (Day 58)

MANIFEST.md

@@ -0,0 +1,44 @@
+# WYRM v27 FINAL — LOCKED VERSION
+## Date: April 8, 2026 (Day 58)
+## Status: TRAINING ON KAGGLE — DO NOT MODIFY
+
+This is the exact version running on Kaggle T4 x2 right now.
+
+### Architecture
+- Total params: 565,816,475
+- Base kernel: 443,744,202
+- Synthase depth: 32,834,328 (6.89%)
+- PUP uncertainty: 6,406 (0.001%)
+- MultiEmbed: 33,560,576
+- Plug: 3,154,944
+- AuxHead: 32,770,048
+- GaussianHead: 19,745,971
+
+### Config
+- dim=1024, layers=24, heads=32, ff=4096
+- Batch: 4 x 4 accum = 16 effective
+- Sequence: 1024
+- Vocab: 16,000 (BPE)
+- Precision: float32
+- Optimizer: AdamW, 10 groups
+- Curriculum: language + math + cognition at multiple depths
+- SLA² on L0, Synthase depth profiles, PUP (disabled loss)
+
+### Files
+- wyrm_notebook_v27_FINAL.py — the Kaggle notebook
+- kernel-metadata.json — Kaggle push metadata
+- dataset/ — exact copy of kaggle_upload/ (kernel + staging + tokenizer)
+
+### Training Metrics (first 60 steps)
+- Loss: 11.31 → 4.81 (57% drop)
+- Task loss: 8.22 → 2.21
+- Best: 2.07
+- VRAM: 5.56 GB / 14.6 GB
+- Step time: ~27s
+- ETA: ~111h (15K steps)
+
+### Kaggle Details
+- Slug: amuzetnom02/wyrm-500m-interactive
+- Dataset: amuzetnom02/wyrm-500m-base
+- Accelerator: GPU T4 x2
+- Account: amuzetnom02