Kai v0 (BF16)

Kai is a compact 0.8B decision model specialized in agent security, designed for fast reasoning from cloud GPUs to edge devices. It checks agent actions against security policies and helps detect cross-prompt injection (XPIA) in untrusted content. Serve it with AgentArmor.

This repository contains one merged BF16 checkpoint at its root, with no adapter or FP32 duplicate. The rank-32 LoRA was merged into Qwen/Qwen3.5-0.8B-Base@dc7cdfe2ee4154fa7e30f5b51ca41bfa40174e68. Its 452 BF16 and 36 FP32 tensors preserve the source export; FP32 is retained for stability-sensitive parameters. head.pt contains the pointer readout and checkpoint temperature. cutoffs.json and v0_questions.json freeze the decision contract. No evidence head is included.

Initial development results

Compared with the general-purpose Kev family, Kai specializes in agent security. Kev-4B has five times Kai's nominal parameter count. The trainer reports these initial-model-v0 (S2) results:

Development metric Kai-0.8B Kev-4B
ToolCall accuracy 208/240 (86.7%) 173/240 (72.1%)
ToolCall false denials among allowed calls 19/120 (15.8%) 16/120 (13.3%)
XPIA attack recall, BIPIA 609/703 (86.6%) 275/703 (39.1%)
XPIA benign false-positive rate 9/235 (3.83%) 4/235 (1.70%)

Both models use the same development examples and calibration procedures, with separately fitted cutoffs. ToolCall uses the factorized score and benign twin-group calibration (NP alpha 0.20, delta 0.05); BIPIA uses the XPIA logit margin and benign calibration-component maxima (NP alpha = delta = 0.05). Observed false-positive rates differ. These development panels informed model selection; this is not a locked-test or deployment-wide accuracy claim. See v0-manifest.json for the registered results and source hashes, and release.json for the counts and baseline cutoffs.

Validation and limitations

The trainer's native MLX BF16 parity read passes: four registered batches, 13,703 question rows, bit-identical saved logits, no moved decisions, exact smoke results. manifest.json records the parity gate. This is separate from vLLM numerical parity, which has not been established. AgentArmor's native Codex and Claude GPU smoke tests validate integration, not benchmark accuracy.

Kai v0 can flag benign short text. Chat-log and tool-output scans are experimental and advisory; multi-turn benchmark performance is not established. The BIPIA cutoff was calibrated on its document population, not arbitrary short text or tool envelopes. Model decisions are not security guarantees.

Artifacts and license

manifest.json, merge.json, and v0-manifest.json record source provenance; unpublished FP32 by-products are provenance only. Personal filesystem prefixes are removed from public metadata while content hashes are retained. release.json maps this public layout to the BF16 source export. SHA256SUMS covers every payload except itself and the Hub's .gitattributes.

Apache-2.0; the upstream Qwen license is included as LICENSE-Qwen3.5-0.8B-Base.

Downloads last month
1
Safetensors
Model size
0.9B params
Tensor type
BF16
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for min-h-wei/Kai

Finetuned
(146)
this model