cygnet for Ollaya

Ollaya package of ggml-org/gemma-4-12B-it-GGUF by blockbrain-ai (recipe) and Google DeepMind (Gemma 4). Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in, calibrated answers out, behind a TypeSafe-compatible API.

ollaya run cygnet

What is in this repository

This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the original model whose weights reference the authors' own weight files by byte offset, so ollaya pull downloads the weights from the upstream repositories, unmodified and pinned to a commit, and verifies their sha256.

Tag Upstream Files
cygnet:12b ggml-org/gemma-4-12B-it-GGUF@e3e6817 12b/decision.json, 12b/calibration.json

Each tag has an fp32 graph, used on CPU and GPU. Each tag also has decision.json (sequence layout, special tokens) and calibration.json (temperatures).

Parity

Ollaya's runner matches stock llama-server of the pinned build (b11146) on the same GGUF, CUDA (RTX 4090): 502 questions, every decision the same, option logits within 7.7e-6 and probabilities within 4.1e-7. The user messages are identical to Cygnet's own shim on 1,364 test prompts.

License

Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ollaya-dev/cygnet

Finetuned
(1)
this model