User01110 commited on
Commit
80088fc
·
verified ·
1 Parent(s): 803c69e

Add inverse theme support to visuals

Browse files
README.md CHANGED
@@ -54,7 +54,7 @@ CMA in the feed-forward position. For every token, CMA reshapes the 288-channel
54
  hidden state into **12 chunks of 24**, routes between those chunks with **3
55
  heads**, applies a signed blend and SiLU gate, then projects back to 288 channels.
56
 
57
- ![CMA 8M architecture](https://huggingface.co/User01110/cma-8M/resolve/main/assets/cma-architecture.svg?v=3)
58
 
59
  ## Quick start
60
 
@@ -137,7 +137,7 @@ Across the logged evaluation checkpoints, normalized bits per byte (BPB)
137
  decreased from **3.7838** to **1.3520**, while the Open SLM Leaderboard-style
138
  average increased from **30.66%** to **36.21%**.
139
 
140
- ![CMA 8M training trajectory](https://huggingface.co/User01110/cma-8M/resolve/main/assets/training-trajectory.svg?v=3)
141
 
142
  ## Evaluation
143
 
 
54
  hidden state into **12 chunks of 24**, routes between those chunks with **3
55
  heads**, applies a signed blend and SiLU gate, then projects back to 288 channels.
56
 
57
+ ![CMA 8M architecture](https://huggingface.co/User01110/cma-8M/resolve/main/assets/cma-architecture.svg?v=4)
58
 
59
  ## Quick start
60
 
 
137
  decreased from **3.7838** to **1.3520**, while the Open SLM Leaderboard-style
138
  average increased from **30.66%** to **36.21%**.
139
 
140
+ ![CMA 8M training trajectory](https://huggingface.co/User01110/cma-8M/resolve/main/assets/training-trajectory.svg?v=4)
141
 
142
  ## Evaluation
143
 
assets/cma-architecture.svg CHANGED
assets/training-trajectory.svg CHANGED