wuff-mann commited on
Commit
d09abde
·
verified ·
1 Parent(s): 0c33452

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -52
README.md CHANGED
@@ -26,86 +26,76 @@ Routing
26
 
27
  Privacy-Preserving
28
 
29
- 🧠 MANN-Engram: Edge-Cloud Multimodal Semantic Router
30
 
31
- A Privacy-First, Zero-Hallucination Shield for Clinical Vision-Language Models.
32
 
33
- MANN-Engram is an orchestration layer designed to solve the "Clinical Input Noise" problem in Large Multimodal Models (LMMs). It synergizes Cloud Intelligence (Qwen-72B) for logical intent distillation with Edge-side Tensor Routing (SiGLIP + MANN) for precise multimodal evidence selection.
34
 
35
- 🚀 The Core Philosophy
36
 
37
- In real-world clinical settings, patient data is notoriously "noisy." A single diagnostic session may contain emotional complaints, hospital billing frustrations, and dozens of unrelated imaging scans. Downstream VLMs often suffer from semantic drift or hallucinations when forced to process this irrelevant context.
38
 
39
- MANN-Engram acts as a "Surgical Filter":
40
 
41
- Linguistic Distillation (Cloud): Using Qwen-2.5-72B to strip away non-medical noise and extract purified clinical intent.
42
 
43
- Tensor Routing (Edge): Projecting intent and imaging into a shared latent space via a Skew-Gaussian optimized SiGLIP engine.
 
 
44
 
45
- Precision Pruning: Only allows verified "Core Evidence" to enter the VLM's context window, significantly reducing hallucination risks.
46
 
47
- 🛠️ Key Capabilities
 
 
 
48
 
49
- Linguistic De-noising: Strips away billing complaints, food issues, and emotional noise from patient narratives.
50
 
51
- Multimodal Saliency Routing: Automatically selects relevant diagnostic scans (MRI/CT/X-ray) from unordered data dumps.
 
 
 
52
 
53
- Dynamic Gate Control (Top_p): An adjustable threshold that allows clinicians to balance between Precision (Strict filtering) and Recall (Safety-first).
54
 
55
- Edge-Cloud Synergy: Offloads logical reasoning to high-parameter cloud models while keeping privacy-sensitive tensor routing localized.
 
 
 
 
 
 
56
 
57
- 🧪 Benchmark Case: "The Neurological Decoy"
58
 
59
- Scenario: A patient complains about hospital food and leg cramps but mentions a seizure and left-sided numbness.
60
 
61
- Input Pool: 1x Brain MRI (Tumor), 1x Chest CT, 1x Abdominal CT, 1x Leg Angiogram.
62
-
63
- Challenge: Can the system ignore the "Decoy" complaints and find the tumor?
64
-
65
- Result: At Top_p = 0.6, MANN-Engram achieves 100% noise suppression, routing only the Brain MRI as the core evidence.
66
-
67
- 📖 Quick Start Guide
68
-
69
- Setup: Obtain a Hugging Face Token and enter it in the "Settings" panel.
70
-
71
- Interact: Paste a messy clinical narrative and upload multiple images.
72
-
73
- Adjust:
74
-
75
- Set Top_p = 0.6 for High Precision.
76
-
77
- Set Top_p = 0.85 for Clinical Safety.
78
-
79
- Observe: Check the "Output Dashboard" for the purified intent and routed gallery.
80
-
81
- 🛠️ For Developers: Integrated SDK
82
-
83
- The core logic is available as a standalone Python SDK for local integration.
84
-
85
- git clone [https://github.com/Mr-wuff/MANN-Engram.git](https://github.com/Mr-wuff/MANN-Engram.git)
86
  cd MANN-Engram
87
  pip install -r requirements.txt
 
88
 
 
89
 
90
- Repository Structure:
 
 
91
 
92
- /mann_engram_en: Core routing and intent extraction logic.
93
 
94
- /weights: Pre-trained Skew-Gaussian weights for SiGLIP routing.
95
-
96
- /examples: Jupyter notebooks for threshold sensitivity analysis.
97
-
98
- 📄 Citation
99
-
100
- If you find this project useful in your research or clinical applications, please cite:
101
 
 
102
  @software{MANN_Engram_2026,
103
  author = {WuFeiFan},
104
  title = {MANN-Engram: Edge-Cloud Multimodal Semantic Router},
105
- url = {[https://github.com/Mr-wuff/MANN-Engram](https://github.com/Mr-wuff/MANN-Engram)},
106
  year = {2026}
107
  }
108
-
109
 
110
  Created with ❤️ by Mr-wuff. Focused on advancing trustworthy AI in healthcare.
111
 
 
26
 
27
  Privacy-Preserving
28
 
29
+ # MANN-Engram: Edge-Cloud Multimodal Semantic Router
30
 
31
+ 🧠 A privacy-first, zero-hallucination shield for clinical vision-language models.
32
 
33
+ ## Overview
34
 
35
+ MANN-Engram is an orchestration layer designed to solve the "Clinical Input Noise" problem in Large Multimodal Models (LMMs). It combines cloud intelligence for logical intent distillation with edge-side tensor routing for precise multimodal evidence selection.
36
 
37
+ ## Core Philosophy
38
 
39
+ Clinical patient data is often noisy. A single diagnostic session may contain emotional complaints, billing frustrations, and unrelated imaging scans. Downstream VLMs can suffer from semantic drift or hallucinations when they process this irrelevant context.
40
 
41
+ MANN-Engram acts as a surgical filter:
42
 
43
+ - **Linguistic Distillation (Cloud)**: Uses Qwen-2.5-72B to remove non-medical noise and extract purified clinical intent.
44
+ - **Tensor Routing (Edge)**: Projects intent and imaging into a shared latent space via a skew-Gaussian optimized SiGLIP engine.
45
+ - **Precision Pruning**: Only verified core evidence is passed to the VLM context window.
46
 
47
+ ## Key Capabilities
48
 
49
+ - **Linguistic de-noising**: Removes billing complaints, food issues, and emotional noise from patient narratives.
50
+ - **Multimodal saliency routing**: Selects relevant diagnostic scans (MRI/CT/X-ray) from unordered data dumps.
51
+ - **Dynamic gate control (`Top_p`)**: Allows clinician-controlled precision vs. recall.
52
+ - **Edge-cloud synergy**: Keeps privacy-sensitive tensor routing local while offloading reasoning to the cloud.
53
 
54
+ ## Benchmark Case: "The Neurological Decoy"
55
 
56
+ - Scenario: A patient complains about hospital food and leg cramps, but also mentions a seizure and left-sided numbness.
57
+ - Input pool: 1x Brain MRI (Tumor), 1x Chest CT, 1x Abdominal CT, 1x Leg Angiogram.
58
+ - Challenge: Ignore the decoy complaints and identify the tumor.
59
+ - Result: At `Top_p = 0.6`, MANN-Engram achieves 100% noise suppression and routes only the Brain MRI as core evidence.
60
 
61
+ ## Quick Start Guide
62
 
63
+ 1. Obtain a Hugging Face token.
64
+ 2. Enter it in the Settings panel.
65
+ 3. Paste a clinical narrative and upload multiple images.
66
+ 4. Adjust `Top_p`:
67
+ - `0.6` for high precision
68
+ - `0.85` for clinical safety
69
+ 5. Review the output dashboard for purified intent and routed evidence.
70
 
71
+ ## Developer Integration
72
 
73
+ The core logic is available as a standalone Python SDK.
74
 
75
+ ```bash
76
+ git clone https://github.com/Mr-wuff/MANN-Engram.git
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  cd MANN-Engram
78
  pip install -r requirements.txt
79
+ ```
80
 
81
+ ## Repository Structure
82
 
83
+ - `mann_engram_en/` — Core routing and intent extraction logic.
84
+ - `weights/` — Pre-trained skew-Gaussian weights for SiGLIP routing.
85
+ - `examples/` — Jupyter notebooks for threshold sensitivity analysis.
86
 
87
+ ## Citation
88
 
89
+ If you use this project in research or clinical applications, please cite:
 
 
 
 
 
 
90
 
91
+ ```bibtex
92
  @software{MANN_Engram_2026,
93
  author = {WuFeiFan},
94
  title = {MANN-Engram: Edge-Cloud Multimodal Semantic Router},
95
+ url = {https://github.com/Mr-wuff/MANN-Engram},
96
  year = {2026}
97
  }
98
+ ```
99
 
100
  Created with ❤️ by Mr-wuff. Focused on advancing trustworthy AI in healthcare.
101