How to use from
OpenClaw
Start the llama.cpp server
# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf marshadbits/athena-functiongemma-270m:F16
Configure OpenClaw
# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "marshadbits/athena-functiongemma-270m:F16" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Quick Links

Athena FunctionGemma-270M (fine-tuned)

LoRA fine-tune of google/functiongemma-270m-it for Athena, the on-device HR assistant in Mis-Genie. Text query -> structured tool call (name + arguments) only -- never free-form text.

  • Real-eval launch gate (hand-written, naturally-phrased HR queries, distinct from training data): 18/20 correct tool+arguments.
  • Synthetic held-out eval: 43/46.
  • Trained on 458 examples covering 7 read-only data tools + a clarification- popup fallback for underspecified queries.

GGUF file (athena-functiongemma-270m-f16.gguf) is ready to serve directly with llama-server (raw llama.cpp, not Ollama) -- pass an explicit "stop": ["<end_function_call>"] in requests; llama-server has no built-in parser for this model's tool-call syntax and will otherwise keep generating past the call.

Two known, understood gaps (not fixed by more training data):

  • Partial employee names ("Taylor" -> "Taylor Reyes") aren't resolved to full names -- an entity-resolution problem for the calling application, not the model.
  • One specific day-range phrasing ("between March 1st and March 15th") is under-represented in training (12/458 examples) and occasionally fails to generate a parseable call.
Downloads last month
27
GGUF
Model size
0.3B params
Architecture
gemma3
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for marshadbits/athena-functiongemma-270m

Quantized
(54)
this model