| license: apache-2.0 | |
| base_model: Cloudflare/clef | |
| base_model_relation: quantized | |
| tags: | |
| - quantized | |
| # clef-FP8 | |
| FP8 W8A8, built with llm-compressor, for vLLM. A quantized build of Cloudflare's Clef (27B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release. | |
| These builds keep the joint schema head, the vision tower, the norms and the Gated DeltaNet gate projections in BF16. The recipes are in the repository. | |
| Paper: https://arxiv.org/abs/2611.15671 | |
| Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench | |
| The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization. | |