metadata
license: cc-by-4.0
PRISM Training & Evaluation Code
This repository contains the training scripts and evaluation notebooks for reproducing the experiments in "Language as a Wave Phenomenon."
WMT14 (Machine Translation)
| Notebook | Description |
|---|---|
| AIAYN_Baseline_Training.ipynb | Standard Transformer baseline (RoPE) |
| FNet_Train_Last.ipynb | FNet hybrid encoder training |
| Gated_PRISM_train_hybrid_RoPE.ipynb | PRISM model used for mechanistic interpretability analysis |
WikiText-103 (Masked Language Modeling)
| Notebook | Description |
|---|---|
| WT103_Transformer_Baseline.ipynb | Transformer baseline |
| FNet_Hybrid_Wikitext_Training.ipynb | FNet hybrid (6 spectral + 1 attention) |
| PRISM_wikitext_103_last.ipynb | PRISM with Dynamic RoSE |
| HSSM_Wikitext_Training.ipynb | Hybrid Spectral Sequence Model (FNet rate + PRISM phase streams) |
| WPT_Wikitext_103_Training.ipynb | Wave-Particle Transformer (Transformer sensory + PRISM relational) |
Evaluation & Analysis
| Notebook | Description |
|---|---|
| Eval_T4_Last.ipynb | Replicates WikiText-103 results using pretrained checkpoints |
| Physical_Validation.ipynb | Generates Figure 3b (iso-energetic validation on WMT14 PRISM) |
| Inspect_Resonances_Last.ipynb | Semantic Phase Compass analysis (Figure 4, Table 2, Appendix figures) |
| Skewness_paper_last.ipynb | Layer-wise skewness and carrier wave threshold analysis (Section 5.4, Figure 5, Table 3) |
Data
All notebooks pull pre-tokenized data from prism-lab/wikitext-103-prism-32k-seq4k and prism-lab/wmt14-de-en-* on HuggingFace.
Note on Weight Tying
All models use tied embeddings (input embeddings = output projection weights). Checkpoint files contain duplicated weights for compatibility. Evaluation scripts redefine model classes with proper weight tying before loading.