LisaMegaWatts commited on
Commit
6d15b31
·
verified ·
1 Parent(s): 01ab113

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -5
README.md CHANGED
@@ -1,10 +1,34 @@
1
  ---
2
- title: SymbioGPT 10M Space
3
- emoji: 👀
4
- colorFrom: red
5
  colorTo: purple
6
  sdk: docker
7
- pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: SymbioGPT-10M
3
+ emoji: 🧬
4
+ colorFrom: green
5
  colorTo: purple
6
  sdk: docker
7
+ app_port: 7860
8
  ---
9
 
10
+ # SymbioGPT-10M
11
+
12
+ Multi-organelle GPT language model (11.6M params) trained on classical philosophy texts.
13
+
14
+ ## Architecture
15
+
16
+ 4 organelles fused via learned per-channel OrganelleGate:
17
+ - **CausalConv** — local n-gram detection (O(n))
18
+ - **MonarchMatrix** — sub-quadratic global mixing via butterfly matrices (O(n sqrt(n)))
19
+ - **LongConv** — dense causal convolution with exponential decay (O(n))
20
+ - **CausalSelfAttention** — multi-head attention with RoPE (O(n^2))
21
+
22
+ Plus: RMSNorm, SwiGLU FFN, SkipGate residuals, weight-tied output.
23
+
24
+ ## API
25
+
26
+ OpenAI-compatible endpoints:
27
+ - `GET /` — health check and model info
28
+ - `GET /v1/models` — list models
29
+ - `POST /v1/chat/completions` — generate text (streaming supported)
30
+
31
+ ## Links
32
+
33
+ - **Model**: [LisaMegaWatts/SymbioGPT-10M](https://huggingface.co/LisaMegaWatts/SymbioGPT-10M)
34
+ - **Source**: [DavinciDreams/symbiogenesis](https://github.com/DavinciDreams/symbiogenesis)