File size: 878 Bytes
7ae79af
efb5636
b59a75e
efb5636
b59a75e
efb5636
b59a75e
 
 
7ae79af
 
 
 
 
 
 
 
f25d5b7
 
7ae79af
 
b59a75e
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
---
license: apache-2.0
base_model: Cloudflare/clef-flash
base_model_relation: quantized
pipeline_tag: image-text-to-text
library_name: transformers
tags:
  - quantized
  - decision-model
---

# clef-flash-FP8

FP8 W8A8, built with llm-compressor, for vLLM. A quantized build of Cloudflare's Clef-flash (9B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.

These builds keep the joint schema head, the vision tower, the norms and the Gated DeltaNet gate projections in BF16. The recipes are in the repository.

Paper: https://arxiv.org/abs/2611.15671

Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench

The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.