Instructions to use EPFLiGHT/EuroLLM-22B-MeditronFO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use EPFLiGHT/EuroLLM-22B-MeditronFO with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="EPFLiGHT/EuroLLM-22B-MeditronFO")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("EPFLiGHT/EuroLLM-22B-MeditronFO")
model = AutoModelForCausalLM.from_pretrained("EPFLiGHT/EuroLLM-22B-MeditronFO")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use EPFLiGHT/EuroLLM-22B-MeditronFO with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "EPFLiGHT/EuroLLM-22B-MeditronFO"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EPFLiGHT/EuroLLM-22B-MeditronFO",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/EPFLiGHT/EuroLLM-22B-MeditronFO

SGLang

How to use EPFLiGHT/EuroLLM-22B-MeditronFO with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "EPFLiGHT/EuroLLM-22B-MeditronFO" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EPFLiGHT/EuroLLM-22B-MeditronFO",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "EPFLiGHT/EuroLLM-22B-MeditronFO" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "EPFLiGHT/EuroLLM-22B-MeditronFO",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use EPFLiGHT/EuroLLM-22B-MeditronFO with Docker Model Runner:
```
docker model run hf.co/EPFLiGHT/EuroLLM-22B-MeditronFO
```

EuroLLM-22B-MeditronFO

EuroLLM-22B-MeditronFO is a 22B-parameter medical specialist LLM, produced by supervised fine-tuning of EuroLLM-22B-Instruct on the Fully Open Meditron Corpus.

This model is part of the Fully Open Meditron family — the first end-to-end auditable pipeline for clinical LLMs, with open weights, open data, open training recipe, and clinician-vetted corpus construction.

EuroLLM-22B-MeditronFO is preferred over its base in 67.2% of Auto-MOOVE pairwise comparisons (adjusted win rate).

📄 Paper: Fully Open Meditron: An Auditable Pipeline for Clinical LLMs
💻 Code: github.com/EPFLiGHT/FullyOpenMeditron
📚 Collection: MeditronFO
🗂️ Training corpus: EPFLiGHT/fully-open-meditron

Performance

Accuracy (%) on standard medical benchmarks. See the paper for full evaluation details, confidence intervals, and open-ended Auto-MOOVE results.

Benchmark	EuroLLM-22B-Instruct	EuroLLM-22B-MeditronFO	Δ
MedMCQA	54.94	54.79	-0.15
MedQA	66.61	63.16	-3.45
PubMedQA	73.60	78.00	+4.40
MedXpertQA	14.61	14.61	+0.00
HealthBench Hard	34.79	37.38	+2.59
Average	48.91	49.59	+0.68

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "EPFLiGHT/EuroLLM-22B-MeditronFO"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "user", "content": "A 62-year-old woman presents with a three-day history of dyspnea on exertion and a productive cough. What is the differential diagnosis?"},
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

outputs = model.generate(**inputs, max_new_tokens=512, do_sample=False)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))

Training

Base model: EuroLLM-22B-Instruct
Corpus: Fully Open Meditron — ~~601k examples (~~150M tokens), aggregating eight public medical QA datasets with three clinician-vetted synthetic components: exam-style QA, guideline-grounded QA from 46,469 clinical practice guidelines, and open-ended clinical vignettes
Hardware: NVIDIA GH200 nodes
Framework: Axolotl with FSDP v2 / DeepSpeed ZeRO-3, Flash Attention 2, bf16 mixed precision
Decontamination: System-wide two-stage n-gram and token-alignment decontamination against all evaluation benchmarks

Full hyperparameters are in Appendix I of the paper.

Intended Use

Research only. This model is intended to support research on medical LLMs, auditing of clinical AI systems, and reproducibility of the Fully Open Meditron pipeline.

It is not validated for clinical deployment, individual patient advice, autonomous decision-making, or any other deployment-adjacent use. Conduct independent domain-specific safety evaluation before any such use.

Citation

todo
}

License

Released under the apache-2.0 license. Permissive use including commercial, subject to attribution.

Downloads last month: 33

Safetensors

Model size

23B params

Tensor type

BF16

Dataset used to train EPFLiGHT/EuroLLM-22B-MeditronFO

Collection including EPFLiGHT/EuroLLM-22B-MeditronFO

MeditronFO

Collection

Our newest Fully Open Meditron collection • 7 items • Updated 1 day ago