How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf beza4588/TenaOS:BF16
# Run inference directly in the terminal:
llama cli -hf beza4588/TenaOS:BF16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf beza4588/TenaOS:BF16
# Run inference directly in the terminal:
llama cli -hf beza4588/TenaOS:BF16
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf beza4588/TenaOS:BF16
# Run inference directly in the terminal:
./llama-cli -hf beza4588/TenaOS:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf beza4588/TenaOS:BF16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf beza4588/TenaOS:BF16
Use Docker
docker model run hf.co/beza4588/TenaOS:BF16
Quick Links

TenaOS — Gemma 4 E4B + Task-Tagged LoRA

TenaOS is a local-first clinical AI operating system for primary-care workflows. This repository hosts the Gemma 4 E4B runtime artifacts used by TenaOS, including the base BF16 GGUF model, multimodal projector, and the task-tagged LoRA adapter trained for TenaOS clinical-informatics workflows.

TenaOS follows a constrained clinical-agent pattern: Gemma proposes, local knowledge bases ground, deterministic middleware validates, and clinicians review before anything is persisted to OpenMRS.

Files

File Purpose
gemma-4-E4B-it-BF16.gguf Base Gemma 4 E4B BF16 GGUF used by the local llama.cpp runtime
mmproj-gemma-4-E4B-it-bf16.gguf Multimodal projector for audio input
adapter/adapter_model.safetensors TenaOS task-tagged LoRA adapter
adapter/adapter_config.json LoRA adapter configuration
adapter/training_metadata.json Training configuration and runtime summary
tenaos-gemma-4-E4B-it-lora-F16.gguf Merged LoRA F16 GGUF artifact
tenaos-gemma-4-E4B-it-lora-Q4_K_M.gguf Optional quantized deployment artifact, when present
tenaos-technical-report.pdf Technical report

The base BF16 GGUF and projector filenames are preserved for compatibility with the TenaOS bootstrap scripts.

Task Tags

The adapter is trained as a single multi-task adapter routed by explicit task tags:

Tag Workflow
[form] Natural-language form and workflow building
[report] Plain-language report planning
[scribe] English text and voice scribing
[scribe-am] Amharic text scribing
[cds] Clinical decision support
[edu] Patient education material generation

Training Summary

The adapter was trained on curated, task-tagged assistant-behaviour traces generated from the TenaOS production workflow stack.

Field Value
Base model google/gemma-4-E4B-it
Training mode 4-bit QLoRA
Validated traces 16,005
Train / validation / test 14,342 / 820 / 843
Epochs / steps 3 / 5,379
LoRA rank / alpha / dropout r=16 / alpha=32 / dropout=0.05
Max sequence length 4,096
Runtime 29.5 hours on A100 80GB
Final train loss 0.0509
Final eval loss 1.1946

Corpus And Training Charts

LoRA corpus funnel

Task mix

Corpus counts

Training runtime

Training loss

Eval loss by checkpoint

Checkpoint metrics

Running With llama.cpp

Base model:

hf download beza4588/TenaOS --local-dir ./models

llama-server \
  -m ./models/gemma-4-E4B-it-BF16.gguf \
  --mmproj ./models/mmproj-gemma-4-E4B-it-bf16.gguf \
  --host 0.0.0.0 \
  --port 8000 \
  -ngl 99 \
  --jinja \
  --alias gemma-4

Merged LoRA model, when using the merged GGUF artifact:

llama-server \
  -m ./models/tenaos-gemma-4-E4B-it-lora-F16.gguf \
  --mmproj ./models/mmproj-gemma-4-E4B-it-bf16.gguf \
  --host 0.0.0.0 \
  --port 8000 \
  -ngl 99 \
  --jinja \
  --alias gemma-4

In TenaOS, the Docker image bind-mounts this directory at /models. See scripts/fetch-models.sh.

Intended Use

This model package is intended for the TenaOS local clinical AI runtime. It is not intended to autonomously diagnose, prescribe, or write directly to a medical record. TenaOS uses allow-listed tools, local WHO/MSF and CIEL knowledge bases, deterministic validation, and clinician review.

Limitations

  • The adapter is trained for TenaOS workflow traces and task tags. It should be evaluated in the full TenaOS runtime rather than as a generic chat model.
  • Workflow-level metrics such as form recall, report correctness, scribe extraction quality, and CDS grounding should be measured after merging the adapter into the runtime.
  • Clinical output remains draft material until reviewed by a qualified clinician.

License

The Gemma model artifacts inherit the Gemma Terms of Use. TenaOS packaging and application code are released separately under the Apache 2.0 license.

Downloads last month
650
GGUF
Model size
8B params
Architecture
gemma4
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for beza4588/TenaOS

Adapter
(194)
this model