---
license: apache-2.0
library_name: llama.cpp
pipeline_tag: text-generation
tags:
- gguf
- 1-bit
- q1_0
- webgpu
- wllama
- on-device
- dflash
base_model:
- prism-ml/Bonsai-1.7B-unpacked
- prism-ml/Bonsai-4B-unpacked
- prism-ml/Bonsai-8B-unpacked
- Qwen/Qwen3.6-27B
---

# Bonsai Web GGUF

Browser-ready, deterministic shards for the
[`WaveCut/bonsai-webgpu-chat`](https://huggingface.co/spaces/WaveCut/bonsai-webgpu-chat)
Space. The files are the pinned Prism ML Bonsai Q1_0 GGUF releases, re-sharded
with `llama-gguf-split --split-max-size 512M` so every browser download stays
below the current wllama single-file limit.

## Contents

| Tier | Architecture | Download | Shards | CPU fallback |
| --- | --- | ---: | ---: | --- |
| `1_7b` | Qwen3 dense | 248,302,336 bytes | 1 | yes |
| `4b` | Qwen3 dense | 572,270,816 bytes | 2 | yes |
| `8b` | Qwen3 dense | 1,158,654,816 bytes | 3 | yes |
| `27b` | Qwen3.5 hybrid | 3,803,453,440 bytes | 8 | no |

The repository also carries
`dflash/Qwen3.6-27B-DFlash-Q8_0.gguf` (1,849,481,440 bytes) as a
**native correctness reference only**. It is not part of a tier download and
is not loaded by the browser Space.

`manifest.json` is the machine-readable contract: immutable source provenance,
ordered shard paths, bytes, SHA-256, context defaults, WebGPU limits, chat
template evidence, and the default-off DFlash research status. `SHA256SUMS`
is the independent shard checksum list.

## Source provenance

| Tier | Source repository | Pinned revision | Original SHA-256 |
| --- | --- | --- | --- |
| `1_7b` | `prism-ml/Bonsai-1.7B-gguf` | `210a9e99f79cb184909d49595906526eb2b3dd9a` | `3d7c6c90dd98717a203adb22d5eacd2581850e40aa5327e144b97766cae5f7e3` |
| `4b` | `prism-ml/Bonsai-4B-gguf` | `78f2c2bacd0904ffaba24b4873ed975e5818354a` | `4524b3f997f0f06444e568d1f26e2efd69effa3218c7ad3047432fb171e42168` |
| `8b` | `prism-ml/Bonsai-8B-gguf` | `48516770dd04643643e9f9019a2a349cf26c5dbd` | `284a335aa3fb2ced3b1b01fcb40b08aa783e3b70832767f0dd2e3fdfa134bd54` |
| `27b` | `prism-ml/Bonsai-27B-gguf` | `0cf7e3d21581b169b4df1de8bf01316000e2fbb7` | `17ef842e47450caeb8eaa3ebfbbab5d2f2278b62b79be107985fb69a2f819aa0` |

The shard container checksums differ from each original monolithic file because
GGUF splitting adds split metadata. No quantization or tensor conversion is
performed.

The first shard of every tier was loaded through llama.cpp's automatic
multi-file resolver and compared with its monolithic source under greedy
sampling. Token IDs and text match exactly: 64/64 tokens for 1.7B and 27B,
and 16/16 tokens for 4B and 8B. The shorter middle-tier checks are load and
reassembly guards, not quality evaluations.

## Loading with wllama

Pass the ordered URLs from `manifest.json` to `loadModelFromUrl`:

```ts
await wllama.loadModelFromUrl(model.files.map((file) => file.url), {
  n_ctx: model.defaultContext,
  n_gpu_layers: 99999,
  flash_attn: false,
  useCache: true,
});
```

The 27B tier is WebGPU-only in the Space. The application must reject it when
adapter limits, storage quota, or full-graph placement are insufficient; it
must not silently fall back to CPU.

## Runtime evidence

The release gate uses pinned llama.cpp `00fa7cb284cbf133fc426733bd64238a3588a33e`
and Dawn `18eb229ef5f707c1464cc581252e7603c73a3ef0`. On Apple M2 Max, all required
Q1_0 and Qwen3.5 hybrid WebGPU operation tests passed. Full-graph 1.7B and 27B
inference requires the token embedding tensor to remain on WebGPU; Flash
Attention stays disabled because quantized K/V combinations are not fully
supported.

## DFlash

DFlash remains inspection-only and default-off in the browser. The manifest
pins the BF16 source and the bundled Q8_0 GGUF reference. Shape, complete
tokenizer equality, target taps `[2, 17, 32, 47, 62]`, conversion, and a
32-token temperature-0 native Bonsai-27B parity smoke pass.

The current custom wllama build contains the DFlash llama.cpp architecture,
but its TypeScript/worker/glue load path does not yet expose
`spec_type=draft-dflash`. The Q8_0 `fc.weight` is 139,264,000 bytes, above the
128 MiB baseline WebGPU storage-buffer binding limit. Browser activation,
acceptance measurement, and a positive decode-speed result therefore remain
hard release gates. The reference must not be presented as a browser-ready
drafter.

## License

The Bonsai model files are published under Apache License 2.0. The DFlash
reference is MIT-licensed. The source license is included as `LICENSE` and
tier/DFlash attribution is preserved under `notices/`.