This is openbmb/AgentCPM-Explore quantized with LLM Compressor with FP8 W8A8. The model has been created and tested by The Valdanito. The model is compatible with SGlang v0.5.7. Tested with an NVIDIA H800.

Downloads last month
10
Safetensors
Model size
4B params
Tensor type
BF16
·
F8_E4M3
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for valdanito/AgentCPM-Explore-FP8-DYNAMIC

Quantized
(9)
this model