Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
|
@@ -26,86 +26,76 @@ Routing
|
|
| 26 |
|
| 27 |
Privacy-Preserving
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
A
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
-
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
|
| 42 |
|
| 43 |
-
|
|
|
|
|
|
|
| 44 |
|
| 45 |
-
|
| 46 |
|
| 47 |
-
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
-
|
| 50 |
|
| 51 |
-
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
-
|
| 54 |
|
| 55 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
|
| 57 |
-
|
| 58 |
|
| 59 |
-
|
| 60 |
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
Challenge: Can the system ignore the "Decoy" complaints and find the tumor?
|
| 64 |
-
|
| 65 |
-
Result: At Top_p = 0.6, MANN-Engram achieves 100% noise suppression, routing only the Brain MRI as the core evidence.
|
| 66 |
-
|
| 67 |
-
📖 Quick Start Guide
|
| 68 |
-
|
| 69 |
-
Setup: Obtain a Hugging Face Token and enter it in the "Settings" panel.
|
| 70 |
-
|
| 71 |
-
Interact: Paste a messy clinical narrative and upload multiple images.
|
| 72 |
-
|
| 73 |
-
Adjust:
|
| 74 |
-
|
| 75 |
-
Set Top_p = 0.6 for High Precision.
|
| 76 |
-
|
| 77 |
-
Set Top_p = 0.85 for Clinical Safety.
|
| 78 |
-
|
| 79 |
-
Observe: Check the "Output Dashboard" for the purified intent and routed gallery.
|
| 80 |
-
|
| 81 |
-
🛠️ For Developers: Integrated SDK
|
| 82 |
-
|
| 83 |
-
The core logic is available as a standalone Python SDK for local integration.
|
| 84 |
-
|
| 85 |
-
git clone [https://github.com/Mr-wuff/MANN-Engram.git](https://github.com/Mr-wuff/MANN-Engram.git)
|
| 86 |
cd MANN-Engram
|
| 87 |
pip install -r requirements.txt
|
|
|
|
| 88 |
|
|
|
|
| 89 |
|
| 90 |
-
|
|
|
|
|
|
|
| 91 |
|
| 92 |
-
|
| 93 |
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
/examples: Jupyter notebooks for threshold sensitivity analysis.
|
| 97 |
-
|
| 98 |
-
📄 Citation
|
| 99 |
-
|
| 100 |
-
If you find this project useful in your research or clinical applications, please cite:
|
| 101 |
|
|
|
|
| 102 |
@software{MANN_Engram_2026,
|
| 103 |
author = {WuFeiFan},
|
| 104 |
title = {MANN-Engram: Edge-Cloud Multimodal Semantic Router},
|
| 105 |
-
url = {
|
| 106 |
year = {2026}
|
| 107 |
}
|
| 108 |
-
|
| 109 |
|
| 110 |
Created with ❤️ by Mr-wuff. Focused on advancing trustworthy AI in healthcare.
|
| 111 |
|
|
|
|
| 26 |
|
| 27 |
Privacy-Preserving
|
| 28 |
|
| 29 |
+
# MANN-Engram: Edge-Cloud Multimodal Semantic Router
|
| 30 |
|
| 31 |
+
🧠 A privacy-first, zero-hallucination shield for clinical vision-language models.
|
| 32 |
|
| 33 |
+
## Overview
|
| 34 |
|
| 35 |
+
MANN-Engram is an orchestration layer designed to solve the "Clinical Input Noise" problem in Large Multimodal Models (LMMs). It combines cloud intelligence for logical intent distillation with edge-side tensor routing for precise multimodal evidence selection.
|
| 36 |
|
| 37 |
+
## Core Philosophy
|
| 38 |
|
| 39 |
+
Clinical patient data is often noisy. A single diagnostic session may contain emotional complaints, billing frustrations, and unrelated imaging scans. Downstream VLMs can suffer from semantic drift or hallucinations when they process this irrelevant context.
|
| 40 |
|
| 41 |
+
MANN-Engram acts as a surgical filter:
|
| 42 |
|
| 43 |
+
- **Linguistic Distillation (Cloud)**: Uses Qwen-2.5-72B to remove non-medical noise and extract purified clinical intent.
|
| 44 |
+
- **Tensor Routing (Edge)**: Projects intent and imaging into a shared latent space via a skew-Gaussian optimized SiGLIP engine.
|
| 45 |
+
- **Precision Pruning**: Only verified core evidence is passed to the VLM context window.
|
| 46 |
|
| 47 |
+
## Key Capabilities
|
| 48 |
|
| 49 |
+
- **Linguistic de-noising**: Removes billing complaints, food issues, and emotional noise from patient narratives.
|
| 50 |
+
- **Multimodal saliency routing**: Selects relevant diagnostic scans (MRI/CT/X-ray) from unordered data dumps.
|
| 51 |
+
- **Dynamic gate control (`Top_p`)**: Allows clinician-controlled precision vs. recall.
|
| 52 |
+
- **Edge-cloud synergy**: Keeps privacy-sensitive tensor routing local while offloading reasoning to the cloud.
|
| 53 |
|
| 54 |
+
## Benchmark Case: "The Neurological Decoy"
|
| 55 |
|
| 56 |
+
- Scenario: A patient complains about hospital food and leg cramps, but also mentions a seizure and left-sided numbness.
|
| 57 |
+
- Input pool: 1x Brain MRI (Tumor), 1x Chest CT, 1x Abdominal CT, 1x Leg Angiogram.
|
| 58 |
+
- Challenge: Ignore the decoy complaints and identify the tumor.
|
| 59 |
+
- Result: At `Top_p = 0.6`, MANN-Engram achieves 100% noise suppression and routes only the Brain MRI as core evidence.
|
| 60 |
|
| 61 |
+
## Quick Start Guide
|
| 62 |
|
| 63 |
+
1. Obtain a Hugging Face token.
|
| 64 |
+
2. Enter it in the Settings panel.
|
| 65 |
+
3. Paste a clinical narrative and upload multiple images.
|
| 66 |
+
4. Adjust `Top_p`:
|
| 67 |
+
- `0.6` for high precision
|
| 68 |
+
- `0.85` for clinical safety
|
| 69 |
+
5. Review the output dashboard for purified intent and routed evidence.
|
| 70 |
|
| 71 |
+
## Developer Integration
|
| 72 |
|
| 73 |
+
The core logic is available as a standalone Python SDK.
|
| 74 |
|
| 75 |
+
```bash
|
| 76 |
+
git clone https://github.com/Mr-wuff/MANN-Engram.git
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
cd MANN-Engram
|
| 78 |
pip install -r requirements.txt
|
| 79 |
+
```
|
| 80 |
|
| 81 |
+
## Repository Structure
|
| 82 |
|
| 83 |
+
- `mann_engram_en/` — Core routing and intent extraction logic.
|
| 84 |
+
- `weights/` — Pre-trained skew-Gaussian weights for SiGLIP routing.
|
| 85 |
+
- `examples/` — Jupyter notebooks for threshold sensitivity analysis.
|
| 86 |
|
| 87 |
+
## Citation
|
| 88 |
|
| 89 |
+
If you use this project in research or clinical applications, please cite:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 90 |
|
| 91 |
+
```bibtex
|
| 92 |
@software{MANN_Engram_2026,
|
| 93 |
author = {WuFeiFan},
|
| 94 |
title = {MANN-Engram: Edge-Cloud Multimodal Semantic Router},
|
| 95 |
+
url = {https://github.com/Mr-wuff/MANN-Engram},
|
| 96 |
year = {2026}
|
| 97 |
}
|
| 98 |
+
```
|
| 99 |
|
| 100 |
Created with ❤️ by Mr-wuff. Focused on advancing trustworthy AI in healthcare.
|
| 101 |
|