This is openbmb/AgentCPM-Explore quantized with LLM Compressor with FP8 W8A8. The model has been created and tested by The Valdanito. The model is compatible with SGlang v0.5.7. Tested with an NVIDIA H800.
- Downloads last month
- 10
This is openbmb/AgentCPM-Explore quantized with LLM Compressor with FP8 W8A8. The model has been created and tested by The Valdanito. The model is compatible with SGlang v0.5.7. Tested with an NVIDIA H800.