toolevalxm commited on
Commit
7a84d9f
·
verified ·
1 Parent(s): 6d6bc26

Upload MedicalExpertModel with benchmark results (epoch 5)

Browse files
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ ---
5
+ # MedicalExpertModel
6
+ <!-- markdownlint-disable first-line-h1 -->
7
+ <!-- markdownlint-disable html -->
8
+ <!-- markdownlint-disable no-duplicate-header -->
9
+
10
+ <div align="center">
11
+ <img src="figures/banner.png" width="60%" alt="MedicalExpertModel" />
12
+ </div>
13
+ <hr>
14
+
15
+ <div align="center" style="line-height: 1;">
16
+ <a href="LICENSE" style="margin: 2px;">
17
+ <img alt="License" src="figures/license_badge.png" style="display: inline-block; vertical-align: middle;"/>
18
+ </a>
19
+ </div>
20
+
21
+ ## 1. Introduction
22
+
23
+ The MedicalExpertModel represents a breakthrough in medical AI assistance. This model has been specifically fine-tuned for clinical and medical applications, demonstrating exceptional performance across medical benchmarks including diagnosis support, treatment recommendations, and medical literature comprehension.
24
+
25
+ <p align="center">
26
+ <img width="80%" src="figures/performance_chart.png">
27
+ </p>
28
+
29
+ The model excels at understanding complex medical terminology, interpreting clinical notes, and providing evidence-based medical information. It has been validated against multiple medical knowledge benchmarks and shows strong performance in clinical reasoning tasks.
30
+
31
+ ## 2. Evaluation Results
32
+
33
+ ### Comprehensive Medical Benchmark Results
34
+
35
+ <div align="center">
36
+
37
+ | | Benchmark | GPT-Medical | MedPaLM | ClinicalBERT | MedicalExpertModel |
38
+ |---|---|---|---|---|---|
39
+ | **Clinical Reasoning** | Diagnosis Accuracy | 0.721 | 0.745 | 0.689 | 0.750 |
40
+ | | Treatment Planning | 0.658 | 0.672 | 0.645 | 0.657 |
41
+ | | Clinical Note Understanding | 0.812 | 0.834 | 0.798 | 0.888 |
42
+ | **Medical Knowledge** | Drug Interactions | 0.789 | 0.801 | 0.756 | 0.769 |
43
+ | | Anatomy Knowledge | 0.845 | 0.856 | 0.823 | 0.820 |
44
+ | | Pathology Understanding | 0.712 | 0.728 | 0.695 | 0.760 |
45
+ | | Medical Terminology | 0.901 | 0.912 | 0.878 | 0.927 |
46
+ | **Patient Care** | Symptom Analysis | 0.734 | 0.751 | 0.712 | 0.721 |
47
+ | | Patient Communication | 0.678 | 0.692 | 0.654 | 0.670 |
48
+ | | Care Plan Generation | 0.645 | 0.659 | 0.623 | 0.627 |
49
+ | | Medical History Analysis | 0.756 | 0.771 | 0.734 | 0.713 |
50
+ | **Specialized Tasks** | Radiology Report Interpretation | 0.689 | 0.705 | 0.667 | 0.731 |
51
+ | | Lab Result Analysis | 0.723 | 0.738 | 0.701 | 0.731 |
52
+ | | Medical Coding Accuracy | 0.767 | 0.782 | 0.745 | 0.771 |
53
+ | | Safety Compliance | 0.834 | 0.848 | 0.812 | 0.871 |
54
+
55
+ </div>
56
+
57
+ ### Overall Performance Summary
58
+ The MedicalExpertModel demonstrates strong performance across all evaluated medical benchmark categories, with particularly notable results in clinical reasoning and medical knowledge domains.
59
+
60
+ ## 3. API and Integration
61
+ We offer a secure API for integration with hospital systems and clinical workflows. Please contact our enterprise team for access.
62
+
63
+ ## 4. How to Run Locally
64
+
65
+ Please refer to our documentation for detailed instructions on running MedicalExpertModel in your environment.
66
+
67
+ ### System Prompt
68
+ We recommend using the following system prompt:
69
+ ```
70
+ You are MedicalExpertModel, a medical AI assistant trained to provide accurate medical information.
71
+ Always recommend consulting healthcare professionals for medical decisions.
72
+ Today is {current date}.
73
+ ```
74
+
75
+ ### Temperature
76
+ We recommend setting the temperature parameter to 0.3 for medical applications.
77
+
78
+ ## 5. License
79
+ This model is licensed under the Apache 2.0 License. Medical use requires appropriate validation.
80
+
81
+ ## 6. Contact
82
+ For enterprise inquiries, please contact us at enterprise@medicalexpertmodel.ai.
config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "architectures": [
4
+ "BertForMaskedLM"
5
+ ],
6
+ "domain": "medical",
7
+ "num_parameters": "110M"
8
+ }
figures/banner.png ADDED
figures/license_badge.png ADDED
figures/performance_chart.png ADDED
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46bf330ac5c15e12719dc63c394f65f5f3ff21299ceed9ea544d3ad30e27accf
3
+ size 45