LisaMegaWatts commited on
Commit
0b47595
·
verified ·
1 Parent(s): 0d89277

Add Wire-2M (H16 L8, seed 42) checkpoint (step 0, bpb 2.1861)

Browse files
Files changed (3) hide show
  1. README.md +43 -0
  2. config.json +14 -0
  3. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - harmonic-gpt
5
+ - oscillator-dynamics
6
+ - clifford-algebra
7
+ - byte-level
8
+ - from-scratch
9
+ - monumental-systems
10
+ language: en
11
+ pipeline_tag: text-generation
12
+ ---
13
+
14
+ # Wire-2M (H16 L8, seed 42)
15
+
16
+ WireNative 2M — n_harmonics=16, 8 layers, baseline seed 42
17
+
18
+ Part of the [Harmonic GPT](https://github.com/DavinciDreams/harmonic-gpt) research into oscillator-based neural computation.
19
+
20
+ ## Architecture: WireNative
21
+
22
+ | Property | Value |
23
+ |----------|-------|
24
+ | Parameters | 2,326,392 |
25
+ | BPB | 2.1861 |
26
+ | Training step | 0 |
27
+ | n_harmonics | 32 |
28
+ | n_layers | 8 |
29
+ | n_groups | 7 |
30
+ | d_model | 448 |
31
+ | Vocab | 256 (raw bytes) |
32
+
33
+ ## Usage
34
+
35
+ ```python
36
+ from huggingface_hub import hf_hub_download
37
+ from safetensors.torch import load_file
38
+
39
+ weights = load_file(hf_hub_download("MonumentalSystems/wire-2m-s42", "model.safetensors"))
40
+ config = json.load(open(hf_hub_download("MonumentalSystems/wire-2m-s42", "config.json")))
41
+ ```
42
+
43
+ All operations are native Clifford algebra / harmonic oscillator dynamics — no softmax attention, no MLP, no ReLU.
config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architecture": "WireNative",
3
+ "n_groups": 7,
4
+ "n_harmonics": 32,
5
+ "n_layers": 8,
6
+ "d_model": 448,
7
+ "n_kan_coeffs": 4,
8
+ "vocab_size": 256,
9
+ "seq_len": 256,
10
+ "training": {
11
+ "step": 0,
12
+ "bpb": 2.186092
13
+ }
14
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aae311b4fc4660fb4ff351c8a26887096f9581b252621babb56bf3e400f381d0
3
+ size 9326240