How to use from
OpenClaw
Start the llama.cpp server
# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf Level5Tech/clef-GGUF:
Configure OpenClaw
# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:9931/v1 \
  --custom-model-id "Level5Tech/clef-GGUF:" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Quick Links

clef-GGUF

GGUF BF16, Q8_0 and Q4_K_M, for llama.cpp b11671. A quantized build of Cloudflare's Clef (27B), made for "The Noise Floor of a Quantization Comparison" by Aleks Blagojevich and Trevor Sunderland (Level5). This isn't an official Cloudflare release.

Paper: https://arxiv.org/abs/2611.15671

Measurements, recipes and per-record outputs: https://github.com/Level5Tech/clef-quant-bench

The paper and all six builds, in one collection: https://huggingface.co/collections/Level5Tech/the-noise-floor-of-a-quantization-comparison-6afd62e8288cc5e14becefaf

Archived release (all versions): https://doi.org/10.5281/zenodo.24184497

The base model is under Apache-2.0. Its LICENSE is included here, and NOTICE says these weights were modified by quantization.

Citation

@misc{blagojevich2026noisefloorquantizationcomparison,
  title={The Noise Floor of a Quantization Comparison: Engine, restart, batch and kernel drift, measured against 8-bit and 4-bit effects in two decision models},
  author={Aleks Blagojevich and Trevor Sunderland},
  year={2026},
  eprint={2611.15671},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2611.15671},
}
Downloads last month
900
GGUF
Model size
27B params
Architecture
clef
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Level5Tech/clef-GGUF

Base model

Qwen/Qwen3.8-27B
Finetuned
Cloudflare/clef
Quantized
(46)
this model

Collection including Level5Tech/clef-GGUF

Paper for Level5Tech/clef-GGUF