Amarthya7 commited on
Commit
ba205bb
Β·
verified Β·
1 Parent(s): fb64b0d

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # MediSync: Multi-Modal Medical Analysis System
2
+
3
+ MediSync is an AI-powered healthcare solution that combines X-ray image analysis with patient report text processing to provide comprehensive medical insights.
4
+
5
+ ## Features
6
+
7
+ - **X-ray Image Analysis**: Detects abnormalities in chest X-rays using pre-trained vision models from Hugging Face.
8
+ - **Medical Report Processing**: Extracts key information from patient reports using NLP models.
9
+ - **Multi-modal Integration**: Combines insights from both image and text data for more accurate diagnosis suggestions.
10
+ - **User-friendly Interface**: Simple web interface for uploading images and reports.
11
+
12
+ ## Project Structure
13
+
14
+ ```
15
+ mediSync/
16
+ β”œβ”€β”€ app.py # Main application with Gradio interface
17
+ β”œβ”€β”€ models/
18
+ β”‚ β”œβ”€β”€ image_analyzer.py # X-ray image analysis module
19
+ β”‚ β”œβ”€β”€ text_analyzer.py # Medical report text analysis module
20
+ β”‚ └── multimodal_fusion.py # Fusion of image and text insights
21
+ β”œβ”€β”€ utils/
22
+ β”‚ β”œβ”€β”€ preprocessing.py # Data preprocessing utilities
23
+ β”‚ └── visualization.py # Result visualization utilities
24
+ β”œβ”€β”€ data/
25
+ β”‚ └── sample/ # Sample data for testing
26
+ └── tests/ # Unit tests
27
+ ```
28
+
29
+ ## Setup Instructions
30
+
31
+ 1. Clone this repository:
32
+ ```bash
33
+ git clone [repository-url]
34
+ cd MediSync
35
+ ```
36
+
37
+ 2. Install dependencies:
38
+ ```bash
39
+ pip install -r requirements.txt
40
+ ```
41
+
42
+ 3. Run the application:
43
+ ```bash
44
+ python app.py
45
+ ```
46
+
47
+ 4. Access the web interface at `http://localhost:7860`
48
+
49
+ ## Models Used
50
+
51
+ - **X-ray Analysis**: facebook/deit-base-patch16-224-medical-cxr
52
+ - **Medical Text Analysis**: medicalai/ClinicalBERT
53
+ - **Additional Support Models**: Medical question answering and entity recognition models
54
+
55
+ ## Use Cases
56
+
57
+ - Preliminary screening of chest X-rays
58
+ - Cross-validation of radiologist reports
59
+ - Educational tool for medical students
60
+ - Research tool for studying correlation between visual findings and written reports
61
+
62
+ ## Note
63
+
64
+ This system is designed as a support tool and should not replace professional medical diagnosis. Always consult with healthcare professionals for medical decisions.