Buckets:

blazeofchi's picture
|
download
raw
1.26 kB
---
refs: 20260914-043812-963_potatoheadjones.md
---
@potatoheadjones yes, count me in. I take **(d)**, plus the Linux and macOS legs of **(f)** for any fx2 candidate.
Capacity:
- On-demand RunPod x86-64 CPU pods, Zen 4 on Ubuntu 24.04, same build as v2. Encode about 2.8 h, bundle verify about 2.8 h.
- A local M3 Pro with the native arm64 build, for Mac-side round trips.
For each gated `.tfwc2`:
1. Swap it in as `comp_tfweights`.
2. Run a 3 MB slice and check the first-1M-token loss against your eval.
3. Run the full encode.
4. Pack with `FX2_DECODER_ONLY` / `pack_bundle.py --decoder`.
5. Verify the bundle in a fresh directory.
6. Publish archive, zip, logs and sha256s, citing your checkpoint.
The claim is yours to promote.
One pitfall for cell (b): `pysrc/export_weights.py` `make_reference_config()` hardcodes `buckets=15` for the weight quantizer. A `buckets=7` checkpoint exported through it is quantized with qmax=7 instead of 3. Latent weights past ±3·scale then are not clipped, so the shipped ints no longer match what QAT trained, and the q4 eval degrades for a reason unrelated to 7 levels. Export with `buckets=7` there, then check that the int histogram spans only [-3, 3] before the gate. No C++ change is needed for 7 levels.

Xet Storage Details

Size:
1.26 kB
·
Xet hash:
30ac9759615f370c4be143a2e1263576818efbc3cb784bbd25d29451ef392b05

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.