chiasm-bridge / docs /architecture.mmd
MongooseReborn's picture
Initial Release: ChiasmBridge Universal Cross-Modal & Dimension-Agnostic Neural Adapter v1.0
0e86f35 verified
Raw
History Blame Contribute Delete
712 Bytes
flowchart TD
subgraph Input ["1. Visual Input"]
Image["πŸ‘οΈ Image / Screen Pixels"]
end
subgraph VisionEncoder ["2. 7B Vision Encoder"]
Encoder["πŸ“· Vision Encoder\n(Outputs 3,584-dim Vision Tokens)"]
end
subgraph ChiasmBridge ["3. ChiasmBridge (libchiasm.so)"]
Bridge["πŸŒ‰ Isomorphic Subspace Projection\n(CUDA VRAM Translation 3,584 -> 5,120)"]
end
subgraph TargetLLM ["4. Target Cognitive LLM"]
LLM["🐺 24B LLM (kalos:24b)\n(Receives 5,120-dim Visual Tokens)"]
end
Image --> Encoder
Encoder -->|3,584-dim Tokens| Bridge
Bridge -->|5,120-dim Tokens| LLM
LLM --> Response["πŸ’¬ Multimodal Visual Perception & Response"]