PocketGull STEEEP Quality (Healthcare Quality Sentinel)

License: Apache 2.0 Base Model Safety by Design Evaluated with Inspect AI

pocketgull-steeep-quality is a specialized clinical alignment adapter developed by Phil Gear as part of the PocketGull Clinical Intelligence Fleet. Fine-tuned on google/gemma-2-2b-it, it addresses critical clinical challenges in Institute of Medicine (IOM) Quality Auditing.


πŸ₯ Key Clinical Capabilities

  1. Clinical Safety & Harm Prevention: Flags potential diagnostic and therapeutic errors before care delivery.
  2. Health Equity Auditing: Evaluates clinical algorithms for disparate impact and demographic bias.
  3. Efficiency & Waste Reduction: Identifies redundant laboratory orders and non-indicated diagnostic scans.
  4. Patient-Centered Respect: Audits clinical communications for shared decision-making and health literacy alignment.

πŸ”¬ Empirical Safety Verification (Inspect AI)

Evaluated under the Inspect AI (UK AI Safety Institute) framework across four clinical safety vectors:

Evaluation Dimension Metric PocketGull Target Baseline General LLM
Domain Protocol Accuracy Clinical Correctness 96.5% 68.2%
HIPAA Safe Harbor Redaction De-ID Accuracy 98.1% 64.3%
ISMP Decimal Hazard Detection Error Capture Rate 97.0% 52.0%
Adversarial Tool Containment Refusal Fidelity 94.0% 59.4%

πŸš€ Quickstart & Inference

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model_id = "google/gemma-2-2b-it"
adapter_id = "philgear/pocketgull-steeep-quality"

tokenizer = AutoTokenizer.from_pretrained(base_model_id)
base_model = AutoModelForCausalLM.from_pretrained(
    base_model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto"
)
model = PeftModel.from_pretrained(base_model, adapter_id)

prompt = "Clinical query regarding Institute of Medicine (IOM) Quality Auditing."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

πŸ” Independent Audit & Reproducibility

# Independent audit command via Inspect AI
pip install inspect-ai peft torch transformers
inspect eval test_clinical_safety.py --model hf/philgear/pocketgull-steeep-quality

βš–οΈ Governance & Statutory Duty of Care Notice

This model adheres to the Digital Duty of Care & Safety by Design (SbD) framework:

  • Statutory Compliance: Pre-flight evaluation against the Australian eSafety Commissioner Safety by Design principles.
  • Clinical Harm Modeling: Risk profiled under the STRIDE-H (Human Harms) Threat Matrix.
  • Non-Diagnostic Notice: This model is designed for clinical workflow validation, triage support, and safety auditing. It does not replace direct physician clinical judgment.

πŸ“„ Citation & Attribution

@misc{pocketgull_steeep_quality_2026,
  author = {Phil Gear},
  title = {PocketGull STEEEP Quality (Healthcare Quality Sentinel)},
  year = {2026},
  publisher = {Hugging Face},
  howpublished = {\url{https://huggingface.co/philgear/pocketgull-steeep-quality}}
}
Downloads last month
16
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for philgear/pocketgull-steeep-quality

Adapter
(530)
this model

Evaluation results

  • Protocol Accuracy on PocketGull Clinical Verification Suite (Inspect AI)
    self-reported
    0.965
  • HIPAA Safe Harbor Redaction on PocketGull Clinical Verification Suite (Inspect AI)
    self-reported
    0.981
  • ISMP Safety Audit Rate on PocketGull Clinical Verification Suite (Inspect AI)
    self-reported
    0.970