Mistral-7B-v0.1-CPT (CPT)

Model description

This checkpoint is a continual-pretrained (CPT) version of Mistral-7B-v0.1, adapted on unlabeled french medical text to strengthen domain-specific representations for medical question answering. CPT is performed via full-parameter training on medical corpora (Dr-BERT/NACHOS).

Downloads last month
6
Safetensors
Model size
7B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train medAdapt/Mistral-7B-v0.1-CPT