Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.format" must be a string
Qwen3.5-9B-MXFP8-CT-RTN-AutoRound
Model Details
This is a MXFP8 quantization of Qwen/Qwen3.5-9B, generated by AutoRound. Please follow the license of the original model.
Quantization Details
- Scheme: MXFP8
- Method: AutoRound
- Base model: Qwen/Qwen3.5-9B
Evaluation
| Benchmark | Score |
|---|---|
| gsm8k | 0.9340 |
| hellaswag | 0.5815 |
| mmlu | 0.7826 |
| piqa | 0.7949 |
Produced with autoquant-agent — agent-driven quantize + evaluate + self-heal.
- Downloads last month
- 15