Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,85 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
license: mit
|
| 2 |
+
language:
|
| 3 |
+
|
| 4 |
+
en
|
| 5 |
+
|
| 6 |
+
zh
|
| 7 |
+
tags:
|
| 8 |
+
|
| 9 |
+
medical
|
| 10 |
+
|
| 11 |
+
multimodal
|
| 12 |
+
|
| 13 |
+
routing
|
| 14 |
+
|
| 15 |
+
RAG
|
| 16 |
+
|
| 17 |
+
siglip
|
| 18 |
+
|
| 19 |
+
π§ MANN-Engram-Router Weights
|
| 20 |
+
|
| 21 |
+
Welcome to the official model hub for MANN-Engram!
|
| 22 |
+
MANN-Engram is an Edge-Cloud Multimodal Semantic Router designed to shield Cloud VLMs (Vision-Language Models) from "Information Tsunamis" in complex medical and high-noise scenarios.
|
| 23 |
+
|
| 24 |
+
This repository hosts the custom Skew-Gaussian tensor routing weights required by the MANN-Engram SDK.
|
| 25 |
+
|
| 26 |
+
π GitHub Repository: MANN-Engram GitHub (Replace with your link)
|
| 27 |
+
|
| 28 |
+
π¦ What's in this Repository?
|
| 29 |
+
|
| 30 |
+
To keep the installation footprint as light as possible, this repository only contains the custom routing core weights (the Skew-Gaussian compressor).
|
| 31 |
+
|
| 32 |
+
The foundational multimodal encoder (google/siglip-so400m-patch14-384) is automatically handled and downloaded by the transformers library when you initialize the SDK.
|
| 33 |
+
|
| 34 |
+
π Directory Structure
|
| 35 |
+
|
| 36 |
+
We provide language-specific routing weights to ensure the highest semantic extraction accuracy:
|
| 37 |
+
|
| 38 |
+
π en/ (English Version - Available Now)
|
| 39 |
+
|
| 40 |
+
skew_model_v4full_en.pt: The core weights for the mann_engram_en Python SDK.
|
| 41 |
+
|
| 42 |
+
π zh/ (Chinese Version - Coming Soon)
|
| 43 |
+
|
| 44 |
+
skew_model_v4full_zh.pt: Optimized for Chinese medical contexts and intent extraction.
|
| 45 |
+
|
| 46 |
+
π Quick Start
|
| 47 |
+
|
| 48 |
+
1. Install the SDK
|
| 49 |
+
|
| 50 |
+
Make sure you have installed the MANN-Engram SDK from our GitHub repository:
|
| 51 |
+
|
| 52 |
+
# Clone the GitHub repo and install
|
| 53 |
+
pip install -e .
|
| 54 |
+
|
| 55 |
+
|
| 56 |
+
2. Download the Weights
|
| 57 |
+
|
| 58 |
+
Download the skew_model_v4full_en.pt file from the en/ folder in this repository. We recommend placing it in a weights/ directory at the root of your project.
|
| 59 |
+
|
| 60 |
+
3. Initialize the Router
|
| 61 |
+
|
| 62 |
+
from mann_engram_en.router import MANNEngramRouter
|
| 63 |
+
|
| 64 |
+
# Initialize the router (Hardcore Local Privacy Mode)
|
| 65 |
+
router = MANNEngramRouter(
|
| 66 |
+
siglip_model_path="google/siglip-so400m-patch14-384", # Handled via Hugging Face automatically
|
| 67 |
+
ckpt_path="./weights/skew_model_v4full_en.pt", # The weight file from this repo
|
| 68 |
+
enable_local_intent=True, # Zero Data Leakage local extraction
|
| 69 |
+
local_intent_model="Qwen/Qwen2.5-0.5B-Instruct"
|
| 70 |
+
)
|
| 71 |
+
|
| 72 |
+
# Start purifying your messy clinical data and multimodal files!
|
| 73 |
+
results = router.process_session(
|
| 74 |
+
raw_chat_input="Doctor hurry up! I hit my head on the door yesterday... Check these lab reports.",
|
| 75 |
+
file_paths=["blood_test.pdf", "history.docx"],
|
| 76 |
+
image_paths=["head_ct.jpg", "leg_mri.jpg"],
|
| 77 |
+
top_p=0.85
|
| 78 |
+
)
|
| 79 |
+
|
| 80 |
+
print(f"β
Successfully extracted core evidence! Stats: {results['stats']}")
|
| 81 |
+
|
| 82 |
+
|
| 83 |
+
π‘οΈ License & Citation
|
| 84 |
+
|
| 85 |
+
These weights are released under the MIT License. If you use MANN-Engram in your research or production, please consider citing our GitHub repository.
|