toolevalxm commited on
Commit
3567e79
·
verified ·
1 Parent(s): 948033b

Upload MedVisionNet-ClinicalRelease model (epoch 500 - best eval_accuracy)

Browse files
Files changed (6) hide show
  1. README.md +61 -53
  2. config.json +5 -7
  3. figures/fig1.png +0 -0
  4. figures/fig2.png +0 -0
  5. figures/fig3.png +0 -0
  6. pytorch_model.bin +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  license: apache-2.0
3
- library_name: transformers
4
  ---
5
  # MedVisionNet
6
  <!-- markdownlint-disable first-line-h1 -->
@@ -20,15 +20,15 @@ library_name: transformers
20
 
21
  ## 1. Introduction
22
 
23
- MedVisionNet represents a breakthrough in medical imaging AI. In this latest release, MedVisionNet has dramatically enhanced its diagnostic accuracy through advanced transfer learning and domain-specific fine-tuning. The model excels across diverse medical imaging modalities including X-rays, CT scans, MRIs, and ultrasound imaging.
24
 
25
  <p align="center">
26
  <img width="80%" src="figures/fig3.png">
27
  </p>
28
 
29
- Compared to the previous version, the upgraded model demonstrates substantial improvements in detecting subtle pathologies. For example, in the ChestX-ray14 benchmark, the model's sensitivity increased from 82% in the previous version to 94% in the current version. This advancement results from deeper feature extraction: the previous model used an average of 256 feature maps, while the new version utilizes 512 feature maps per layer.
30
 
31
- Beyond improved detection capabilities, this version offers enhanced explainability through attention mapping and reduced false-positive rates in screening applications.
32
 
33
  ## 2. Evaluation Results
34
 
@@ -36,78 +36,86 @@ Beyond improved detection capabilities, this version offers enhanced explainabil
36
 
37
  <div align="center">
38
 
39
- | | Benchmark | RadNet-1 | DiagAI | MedScan-v2 | MedVisionNet |
40
  |---|---|---|---|---|---|
41
- | **Primary Diagnostics** | Tumor Detection | 0.812 | 0.835 | 0.841 | 0.779 |
42
- | | Organ Segmentation | 0.789 | 0.801 | 0.815 | 0.800 |
43
- | | Fracture Detection | 0.756 | 0.772 | 0.785 | 0.821 |
44
- | **Specialized Screening** | Retinal Screening | 0.871 | 0.885 | 0.890 | 0.884 |
45
- | | Chest X-ray Classification | 0.782 | 0.799 | 0.811 | 0.750 |
46
- | | Skin Lesion Analysis | 0.803 | 0.821 | 0.830 | 0.839 |
47
- | | Brain MRI Analysis | 0.767 | 0.781 | 0.799 | 0.771 |
48
- | **Advanced Imaging** | Cardiac Imaging | 0.715 | 0.731 | 0.748 | 0.721 |
49
- | | Mammography Screening | 0.788 | 0.805 | 0.812 | 0.752 |
50
- | | CT Scan Interpretation | 0.721 | 0.739 | 0.755 | 0.806 |
51
- | | Pathology Classification | 0.845 | 0.865 | 0.870 | 0.892 |
52
- | **Anatomical Analysis**| Ultrasound Analysis | 0.682 | 0.699 | 0.715 | 0.696 |
53
- | | Bone Density Assessment | 0.751 | 0.768 | 0.780 | 0.681 |
54
- | | Lesion Localization | 0.733 | 0.749 | 0.761 | 0.755 |
55
- | | Anatomical Landmark Detection | 0.818 | 0.831 | 0.845 | 0.794 |
56
 
57
  </div>
58
 
59
  ### Overall Performance Summary
60
- MedVisionNet demonstrates state-of-the-art performance across all evaluated medical imaging benchmark categories, with particularly strong results in tumor detection and pathology classification.
61
 
62
- ## 3. Clinical API & Web Interface
63
- We offer a HIPAA-compliant API and web interface for clinical integration with MedVisionNet. Please contact our healthcare partnerships team for deployment details.
64
 
65
  ## 4. How to Run Locally
66
 
67
- Please refer to our clinical documentation repository for detailed deployment instructions.
68
 
69
- Compared to previous versions, the deployment recommendations for MedVisionNet have the following changes:
70
 
71
- 1. DICOM format is now natively supported.
72
- 2. Multi-GPU inference is enabled by default for batch processing.
73
 
74
- The model architecture of MedVisionNet-Lite is a distilled version suitable for edge deployment.
75
 
76
- ### Preprocessing Requirements
77
- We recommend using the following preprocessing pipeline:
78
  ```
79
- Standard medical image normalization with HU windowing for CT scans.
80
- Image size: 512x512 pixels minimum resolution.
 
 
 
 
 
81
  ```
82
 
83
- ### Inference Parameters
84
- We recommend setting the confidence threshold to 0.7 for screening applications.
85
 
86
- ### Input Format for DICOM Processing
87
- For DICOM file processing, please follow this template where {patient_id}, {study_uid}, and {series_uid} are arguments:
88
  ```
89
- dicom_template = \
90
- """[patient_id]: {patient_id}
91
- [study_uid]: {study_uid}
92
- [series_uid]: {series_uid}
93
- """
 
94
  ```
95
 
96
- For batch processing with anonymization enabled, we recommend the following configuration:
97
  ```
98
- batch_config = \
99
- '''# Batch Processing Configuration
100
- {study_list}
101
- Processing parameters:
102
- - Anonymization: Enabled
103
- - Date: {processing_date}
104
- - Output format: {output_format}
105
- '''
 
 
 
106
  ```
107
 
108
  ## 5. License
109
- This code repository is licensed under the [Apache-2.0 License](LICENSE). The use of MedVisionNet models is subject to healthcare regulatory compliance requirements.
110
 
111
  ## 6. Contact
112
- If you have any questions, please raise an issue on our GitHub repository or contact us at clinical@medvisionnet.ai.
113
- ```
 
1
  ---
2
  license: apache-2.0
3
+ library_name: monai
4
  ---
5
  # MedVisionNet
6
  <!-- markdownlint-disable first-line-h1 -->
 
20
 
21
  ## 1. Introduction
22
 
23
+ MedVisionNet represents a breakthrough in medical imaging AI. This deep learning model has been specifically designed for multi-modal medical image analysis, supporting CT, MRI, X-ray, and ultrasound imaging modalities. The model leverages transformer-based attention mechanisms combined with convolutional backbones to achieve state-of-the-art performance across clinical diagnostic tasks.
24
 
25
  <p align="center">
26
  <img width="80%" src="figures/fig3.png">
27
  </p>
28
 
29
+ In clinical validation studies, MedVisionNet demonstrated exceptional performance across multiple diagnostic categories. The model achieved a sensitivity of 94.2% for early-stage tumor detection, significantly outperforming radiologist baseline performance of 87.3%. For organ segmentation tasks, the model achieved a Dice coefficient improvement from 0.82 to 0.91 compared to previous versions.
30
 
31
+ The architecture incorporates FDA-compliant uncertainty quantification, providing confidence scores that assist clinicians in decision-making while maintaining regulatory compliance for medical device software.
32
 
33
  ## 2. Evaluation Results
34
 
 
36
 
37
  <div align="center">
38
 
39
+ | | Benchmark | RadNet-v1 | ClinicalAI | DeepMed-2 | MedVisionNet |
40
  |---|---|---|---|---|---|
41
+ | **Core Diagnostic Tasks** | Tumor Detection | 0.821 | 0.835 | 0.842 | 0.890 |
42
+ | | Organ Segmentation | 0.765 | 0.781 | 0.790 | 0.836 |
43
+ | | Fracture Detection | 0.889 | 0.901 | 0.912 | 0.940 |
44
+ | **Classification Tasks** | Lesion Classification | 0.723 | 0.739 | 0.752 | 0.728 |
45
+ | | Nodule Detection | 0.812 | 0.825 | 0.831 | 0.896 |
46
+ | | Tissue Analysis | 0.698 | 0.711 | 0.725 | 0.759 |
47
+ | | Anomaly Detection | 0.756 | 0.768 | 0.779 | 0.777 |
48
+ | **Advanced Analytics** | Vessel Tracking | 0.687 | 0.695 | 0.708 | 0.744 |
49
+ | | Disease Staging | 0.734 | 0.748 | 0.761 | 0.802 |
50
+ | | Image Registration | 0.812 | 0.823 | 0.835 | 0.919 |
51
+ | | Dose Prediction | 0.651 | 0.667 | 0.679 | 0.687 |
52
+ | **Clinical Outcomes** | Survival Analysis | 0.723 | 0.735 | 0.748 | 0.805 |
53
+ | | Treatment Response | 0.689 | 0.702 | 0.715 | 0.689 |
54
+ | | Biomarker Extraction | 0.778 | 0.791 | 0.803 | 0.822 |
55
+ | | Safety Compliance | 0.912 | 0.921 | 0.928 | 0.894 |
56
 
57
  </div>
58
 
59
  ### Overall Performance Summary
60
+ MedVisionNet demonstrates strong performance across all evaluated clinical benchmark categories, with particularly notable results in diagnostic accuracy and FDA safety compliance metrics.
61
 
62
+ ## 3. Clinical Portal & API Platform
63
+ We offer a HIPAA-compliant clinical portal and REST API for healthcare institutions to integrate MedVisionNet. Please contact our enterprise team for deployment options.
64
 
65
  ## 4. How to Run Locally
66
 
67
+ Please refer to our code repository for information about deploying MedVisionNet in your clinical environment.
68
 
69
+ Key deployment considerations for MedVisionNet:
70
 
71
+ 1. DICOM integration is supported via PyDICOM.
72
+ 2. GPU acceleration requires CUDA 11.8+ for optimal inference speed.
73
 
74
+ The model architecture follows the MONAI framework conventions and can be loaded using standard PyTorch methods.
75
 
76
+ ### System Requirements
77
+ We recommend the following hardware specifications for clinical deployment:
78
  ```
79
+ GPU: NVIDIA A100 or V100 (40GB VRAM minimum)
80
+ RAM: 64GB minimum
81
+ Storage: 500GB SSD for model caching
82
+ ```
83
+ For example deployment configuration:
84
+ ```
85
+ docker run --gpus all -p 8080:8080 medvisionnet:latest
86
  ```
87
 
88
+ ### Temperature
89
+ For diagnostic predictions, we recommend temperature scaling with $T_{model}$ = 0.8 for optimal calibration.
90
 
91
+ ### Input Preprocessing
92
+ For DICOM input, please follow the standardized preprocessing pipeline:
93
  ```
94
+ preprocessing_config = \
95
+ """[modality]: {modality_type}
96
+ [window_center]: {wc}
97
+ [window_width]: {ww}
98
+ [normalization]: hounsfield_to_unit
99
+ {input_path}"""
100
  ```
101
 
102
+ For multi-modal fusion inference, we recommend the following configuration where {ct_path}, {mri_path}, and {clinical_notes} are arguments:
103
  ```
104
+ fusion_template = \
105
+ '''# Multi-modal Medical Image Fusion Pipeline
106
+ {ct_dicom_path}
107
+ {mri_dicom_path}
108
+ Integration of imaging data with clinical context requires proper alignment of spatial coordinates. Each input modality should be registered to a common anatomical reference frame before fusion.
109
+ Key processing considerations:
110
+ - Apply histogram matching for intensity normalization.
111
+ - Use affine registration for gross alignment.
112
+ - Apply deformable registration for local corrections.
113
+ - Clinical notes provide context for diagnostic reasoning.
114
+ {clinical_notes}'''
115
  ```
116
 
117
  ## 5. License
118
+ This model is released under the [Apache 2.0 License](LICENSE). Commercial use requires validation study completion and regulatory clearance in your jurisdiction.
119
 
120
  ## 6. Contact
121
+ For clinical inquiries, please contact our medical affairs team at clinical@medvisionnet.ai or submit a support ticket through our enterprise portal.
 
config.json CHANGED
@@ -1,10 +1,8 @@
1
  {
2
- "model_type": "vit",
3
- "architectures": ["ViTForImageClassification"],
4
- "image_size": 512,
5
- "patch_size": 16,
6
- "num_channels": 1,
7
  "hidden_size": 768,
8
- "num_attention_heads": 12,
9
- "medical_domain": "radiology"
10
  }
 
1
  {
2
+ "model_type": "vision_transformer",
3
+ "architectures": ["MedVisionNet"],
4
+ "input_channels": 1,
5
+ "output_classes": 15,
 
6
  "hidden_size": 768,
7
+ "num_attention_heads": 12
 
8
  }
figures/fig1.png CHANGED
figures/fig2.png CHANGED
figures/fig3.png CHANGED
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e525264b4dadaa720e7842d3355edcc9a5aaaacfad1fa9f504306d0ef9bc302b
3
- size 49
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fce82d1f7dcc56ae65266809c7cf448078aeee519baeb208f75debb4f74b1fcf
3
+ size 42