MedDiagnosticAI

MedDiagnosticAI

1. Introduction

MedDiagnosticAI represents a breakthrough in healthcare artificial intelligence. This latest version has been enhanced with improved clinical reasoning capabilities, leveraging extensive medical literature and anonymized patient data during training. The model demonstrates exceptional performance across various medical diagnostic benchmarks, including disease classification, symptom recognition, and treatment recommendations.

Compared to the previous version, MedDiagnosticAI shows significant improvements in complex diagnostic scenarios. For instance, in the MedQA-USMLE test, the model's accuracy has increased from 65% in the previous version to 82.3% in the current version. This advancement stems from enhanced medical knowledge integration and improved clinical reasoning chains.

Beyond its improved diagnostic capabilities, this version offers reduced false positive rates and enhanced support for multi-modal medical data analysis.

2. Evaluation Results

Comprehensive Benchmark Results

Benchmark ClinicalBERT MedBERT BioClinicalBERT MedDiagnosticAI
Core Diagnostic Tasks Disease Classification 0.723 0.741 0.756 0.564
Symptom Recognition 0.681 0.695 0.712 0.577
Drug Interaction 0.645 0.668 0.679 0.692
Clinical Understanding Medical Imaging 0.589 0.612 0.631 0.465
Patient Triage 0.712 0.728 0.745 0.625
Clinical Notes 0.634 0.651 0.669 0.600
Lab Interpretation 0.698 0.715 0.729 0.593
Treatment Tasks Treatment Recommendation 0.567 0.589 0.608 0.530
Vital Signs Analysis 0.745 0.762 0.778 0.719
Medical QA 0.623 0.641 0.658 0.693
Adverse Event Detection 0.689 0.705 0.721 0.649
Specialized Capabilities Dosage Calculation 0.812 0.829 0.843 0.744
Prognosis Prediction 0.578 0.595 0.612 0.506
Emergency Response 0.701 0.718 0.734 0.637
Patient Risk Assessment 0.656 0.673 0.689 0.555

Overall Performance Summary

MedDiagnosticAI demonstrates strong performance across all evaluated healthcare benchmark categories, with particularly notable results in diagnostic and treatment recommendation tasks.

3. Clinical Integration & API Platform

We offer a clinical integration interface and API for healthcare providers to integrate MedDiagnosticAI. Please check our official website for more details.

4. How to Run Locally

Please refer to our code repository for more information about deploying MedDiagnosticAI locally.

Compared to previous versions, the usage recommendations for MedDiagnosticAI have the following changes:

  1. HIPAA-compliant system prompt is supported.
  2. Clinical context injection is enabled for improved diagnostic accuracy.

The model architecture of MedDiagnosticAI-Lite is identical to its base model, but it shares the same tokenizer configuration as the main MedDiagnosticAI.

System Prompt

We recommend using the following system prompt for clinical applications.

You are MedDiagnosticAI, a clinical decision support assistant.
Today is {current date}.
IMPORTANT: This tool provides decision support only. All clinical decisions must be verified by licensed healthcare professionals.

Temperature

We recommend setting the temperature parameter $T_{model}$ to 0.3 for clinical applications to ensure more deterministic outputs.

Prompts for Patient Record Analysis

For patient record uploading, please follow the template to create prompts, where {patient_id}, {clinical_data} and {clinical_query} are arguments.

patient_template = \
"""[Patient ID]: {patient_id}
[Clinical Data Begin]
{clinical_data}
[Clinical Data End]
{clinical_query}"""

5. License

This code repository is licensed under the Apache 2.0 License. The use of MedDiagnosticAI models is subject to the Apache 2.0 License and additional healthcare compliance requirements.

6. Contact

If you have any questions, please raise an issue on our GitHub repository or contact us at clinical-support@meddiagnosticai.health.


Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support