File size: 2,541 Bytes
75d6620 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 | ---
license: apache-2.0
language:
- en
tags:
- mlx
- safetensors
- qwen3.6
- bonsai
- apple-silicon
- experimental
pipeline_tag: text-generation
library_name: mlx
base_model:
- prism-ml/Bonsai-27B-gguf
---
# Bonsai 27B MLX BF16 Config-Repaired
This is a mechanically converted MLX BF16 archival baseline for the Bonsai 27B
quantization experiment on Apple Silicon. It exists to make later Q4, Q8, oQ4,
and oQ8 builds reproducible without treating an opaque local directory as the
source of truth.
It is **not a recommended inference checkpoint**. The 50 GB BF16 footprint
cannot be run on the 32 GB Apple Silicon host used to create it, so this upload
establishes structure and provenance, not runtime quality.
## Provenance
- Upstream source: [`prism-ml/Bonsai-27B-gguf`](https://huggingface.co/prism-ml/Bonsai-27B-gguf)
- Source revision: `0cf7e3d21581b169b4df1de8bf01316000e2fbb7`
- Source file: `Bonsai-27B-F16.gguf`
- Source SHA-256: `d4a381a6d07131c34af888607bdbda49fc885c97673a0d22aa3e0f0284bba566`
- Base architecture: Qwen/Qwen3.6-27B through Bonsai 27B
- Conversion output: MLX-compatible safetensors, 11 shards, 851 indexed tensors
- License: Apache-2.0. Upstream `LICENSE.txt` and `NOTICE.txt` are retained.
The conversion preserved tensor values. One configuration-only repair was made:
the source declares one MTP layer but includes no `mtp.*` tensor. The derived
`config.json` sets `text_config.mtp_num_hidden_layers` to `0`; the untouched
configuration is retained as `config.pre-mtp-repair.json`. See
[`MTP_CONFIGURATION_REPAIR.md`](./MTP_CONFIGURATION_REPAIR.md).
## Integrity
`output-sha256.txt` records SHA-256 hashes for every model shard and core
metadata file. `PROVENANCE.json` records the source, structural checks, and
local artifact hashes. The current derived `config.json` hash is
`4dd1fd34daa8916c5eecc8e6a9ca9ce3564226518704768efe9b76d4deb34b2f`.
## Intended Use
Use this only as a reproducible conversion baseline for a controlled local
quantization study. Follow-on releases should publish their conversion recipe,
calibration settings, evaluation results, and exact artifact hashes. A generic
2-bit affine experiment from this study failed deterministic output screens and
is intentionally not distributed as a usable model.
## Attribution
Created by Technologies Brewster Jennings du Canada for the Bonsai MLX
quantization experiment. Bonsai is created by Prism ML and derived from
Qwen3.6-27B. Please consult the upstream Bonsai card for original model
limitations, benchmarks, and citations.
|