clef-NVFP4 / README.md
aleksblago's picture
Link the collection and the Zenodo archive, add the citation (#4)
a8e2147
|
Raw History Blame Contribute Delete
1.55 kB
---
license: apache-2.0
base_model: Cloudflare/clef
base_model_relation: quantized
pipeline_tag: image-text-to-text
library_name: transformers
tags:
- quantized
- decision-model
- 4-bit
- nvfp4
---
# clef-NVFP4
NVFP4 W4A4, built with llm-compressor, for vLLM. A quantized build of Cloudflare's Clef (27B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.
These builds keep the joint schema head, the vision tower, the norms and the Gated DeltaNet gate projections in BF16. The recipes are in the repository.
Paper: https://arxiv.org/abs/2611.15671
Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench
The paper and all six builds, in one collection: https://huggingface.co/collections/Level5Tech/the-noise-floor-of-a-quantization-comparison-6afd62e8288cc5e14becefaf
Archived release (all versions): https://doi.org/10.5281/zenodo.24184497
The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.
## Citation
```bibtex
@misc{blagojevich2026noisefloorquantizationcomparison,
title={The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models},
author={Aleks Blagojevich and Trevor Sunderland},
year={2026},
eprint={2611.15671},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2611.15671},
}
```