Spaces:
Running on Zero
Running on Zero
File size: 1,438 Bytes
cfeec66 30d966c cfeec66 30d966c cfeec66 30d966c cfeec66 30d966c c8021f8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 | ---
title: G-MASS - Ghana Medical AI Safety Screen
emoji: 🏥
colorFrom: blue
colorTo: yellow
sdk: gradio
sdk_version: 5.23.1
app_file: app.py
pinned: true
license: apache-2.0
tags:
- medical-ai
- ai-safety
- ghana
- twi
- african-languages
- llm-evaluation
- health
- nlp
short_description: Medical AI safety eval for Ghanaian languages
---
# G-MASS - Ghana Medical AI Safety Screen
G-MASS tests whether AI health assistants respond safely to medical queries in
English, Ghanaian English, and Twi.
## What This Space Runs
- Evaluated model keys: `gpt4o`, `gemini`, `phi3`, `biomistral`.
- Scorer identities: LlamaGuard3, Gemma, and AfroLM.
- `SCORER_BACKEND=policy_api` may use Gemini API as the hosted scorer runtime,
but Gemini is not counted as a scorer identity.
- Benchmark charts load real combined results when available; no placeholder
benchmark numbers are displayed.
## Required Secrets
- `OPENAI_API_KEY` for GPT-4o.
- `GEMINI_API_KEY` for Gemini and `SCORER_BACKEND=policy_api`.
- `HF_TOKEN` for Hugging Face router/open-weight models.
- `KHAYA_API_KEY` when using hosted Khaya translation.
Outputs are evaluation signals, not clinical deployment certification.
## Runtime Note
This demo uses cloud/API calls and CPU-side orchestration by default. It includes
a small ZeroGPU compatibility marker for Spaces that are forced onto ZeroGPU,
but CPU hardware is the intended runtime when available.
|