GlobalHealthAtlas Public Model

This repository contains the fine-tuned LoRA adapter for the GlobalHealthAtlas Public Model, introduced in the paper From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlas.

The model is designed to provide informative, context-aware answers to public health–related queries across 15 domains and 17 languages. It was fine-tuned from Qwen/Qwen3-8B on the GlobalHealthAtlas dataset.

Overview

Public health reasoning requires population-level inference grounded in scientific evidence, expert consensus, and safety constraints. This model addresses the scarcity of supervised signals in this domain. It was trained on the GlobalHealthAtlas dataset, a large-scale multilingual corpus of 280,210 instances spanning 15 domains including infectious disease prevention, health policy, and vaccination.

Intended Uses & Limitations

This model is intended to be used as a question-answering and information retrieval component for research and public health queries.

Important Disclaimer: This model is NOT intended for clinical diagnosis, medical advice, or other high‑stakes decision-making without human review by domain experts.

Training Procedure

The model was fine-tuned using LoRA (Low-Rank Adaptation) on the Qwen3-8B base model via the LLaMA Factory framework.

Training Hyperparameters

The following hyperparameters were used during training:

  • Learning rate: 5e-05
  • Train batch size: 1
  • Gradient accumulation steps: 8
  • Total train batch size: 8
  • Optimizer: AdamW
  • LR scheduler type: cosine
  • LR scheduler warmup ratio: 0.1
  • Num epochs: 2.0
  • Seed: 42

Framework Versions

  • PEFT 0.15.1
  • Transformers 4.51.3
  • Pytorch 2.3.0+cu121
  • Datasets 3.2.0
  • Tokenizers 0.21.0

Citation

If you use this model or the GlobalHealthAtlas dataset, please cite:

@article{globalhealthatlas2026,
  title={From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlas},
  author={GlobalHealthAtlas Team},
  year={2026}
}
Downloads last month
17
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for aerovane0/GlobalHealthAtlas_Public_Model

Finetuned
Qwen/Qwen3-8B
Adapter
(1439)
this model

Paper for aerovane0/GlobalHealthAtlas_Public_Model