| license: mit | |
| tags: | |
| - harmonic-gpt | |
| - oscillator-dynamics | |
| - clifford-algebra | |
| - byte-level | |
| - from-scratch | |
| - monumental-systems | |
| language: en | |
| pipeline_tag: text-generation | |
| # Wire-2M (H16 L8, seed 42) | |
| WireNative 2M — n_harmonics=16, 8 layers, baseline seed 42 | |
| Part of the [Harmonic GPT](https://github.com/DavinciDreams/harmonic-gpt) research into oscillator-based neural computation. | |
| ## Architecture: WireNative | |
| | Property | Value | | |
| |----------|-------| | |
| | Parameters | 2,326,392 | | |
| | BPB | 2.1861 | | |
| | Training step | 0 | | |
| | n_harmonics | 32 | | |
| | n_layers | 8 | | |
| | n_groups | 7 | | |
| | d_model | 448 | | |
| | Vocab | 256 (raw bytes) | | |
| ## Usage | |
| ```python | |
| from huggingface_hub import hf_hub_download | |
| from safetensors.torch import load_file | |
| weights = load_file(hf_hub_download("MonumentalSystems/wire-2m-s42", "model.safetensors")) | |
| config = json.load(open(hf_hub_download("MonumentalSystems/wire-2m-s42", "config.json"))) | |
| ``` | |
| All operations are native Clifford algebra / harmonic oscillator dynamics — no softmax attention, no MLP, no ReLU. | |