How to use from
SGLang
Install from pip and serve model
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Level5Tech/clef-FP8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Level5Tech/clef-FP8",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'
Use Docker images
docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Level5Tech/clef-FP8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Level5Tech/clef-FP8",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'
Quick Links

clef-FP8

FP8 W8A8, built with llm-compressor, for vLLM. A quantized build of Cloudflare's Clef (27B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.

These builds keep the joint schema head, the vision tower, the norms and the Gated DeltaNet gate projections in BF16. The recipes are in the repository.

Paper: https://arxiv.org/abs/2611.15671

Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench

The paper and all six builds, in one collection: https://huggingface.co/collections/Level5Tech/the-noise-floor-of-a-quantization-comparison-6afd62e8288cc5e14becefaf

Archived release (all versions): https://doi.org/10.5281/zenodo.24184497

The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.

Citation

@misc{blagojevich2026noisefloorquantizationcomparison,
  title={The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models},
  author={Aleks Blagojevich and Trevor Sunderland},
  year={2026},
  eprint={2611.15671},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2611.15671},
}
Downloads last month
76
Safetensors
Model size
27B params
Tensor type
BF16
·
F8_E4M3
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Level5Tech/clef-FP8

Base model

Qwen/Qwen3.8-27B
Finetuned
Cloudflare/clef
Quantized
(46)
this model

Collection including Level5Tech/clef-FP8

Paper for Level5Tech/clef-FP8