MedLLaMA-13B-CPT-SFT (CPT+SFT)

Model description

This checkpoint applies two-stage domain adaptation:

  1. CPT on unlabeled medical text to adapt representations on Dr-BERT/NACHOS corpus , then
  2. SFT on labeled medical QA to optimize task performance (MedInjection-FR/ALL) .
Downloads last month
14
Safetensors
Model size
13B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for medAdapt/MedLLaMA-13B-CPT-SFT

Quantizations
2 models