File size: 1,788 Bytes
785f3d7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 | # Kaiju Coder 7 GGUF Candidate
This folder documents the persisted GGUF candidate for Kaiju Coder 7. The
artifact exists on Gojira-B, but it should stay marked as a candidate until a
runtime smoke test passes.
## Artifact
- Format: GGUF
- Outtype: `q8_0`
- Remote path:
`/home/richardecholsai5/kaiju-coder/models/kaiju-coder-7-gguf/kaiju-coder-7-Q8_0.gguf`
- Remote size: `27G`
- SHA256:
`596a2c227a429c7309db753061d88d71ee3f8a3b48f17e41ba9d81b0f55bdd4e`
- Source model:
`/home/richardecholsai5/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged`
- Conversion evidence:
`runs/gguf-conversion/20260603T231446Z/gguf-conversion.log`
## Status
Converted successfully on 2026-06-03. Runtime smoke is still required before
public upload or a Hugging Face quantized-weights claim.
The conversion path is promising because the current `llama.cpp`
`convert_hf_to_gguf.py` support list includes `Qwen3_5ForConditionalGeneration`
and the Q8_0 dry run completed before the real conversion.
## Recreate
```bash
./scripts/probe-gojira-b-persisted-quantization.sh
./scripts/run-gojira-b-kaiju-gguf-convert.sh
```
The conversion script stops the active vLLM runtime to free RAM, writes the GGUF
artifact, records a checksum and manifest, then restarts the fast vLLM runtime.
## Release Rule
Do not publish this as public quantized weights until all of these pass:
- runtime loads the GGUF with model id `kaiju-coder-7`
- direct identity smoke passes
- direct business-owner document smoke passes
- OpenCode or router smoke passes through the intended runtime
- README/model card states exact runtime, context, memory, and quality caveats
Until then, the public quantized path remains `kaiju-coder-7-quantized-runtime`,
which documents the already-smoked vLLM bitsandbytes setup.
|