| # OpenMOSS-Team/MOSS-VL-Instruct-0708-NF4 | |
| - Runtime: Transformers `offline_generate`. | |
| - Weights: bitsandbytes NF4 with double quantization on 240 eligible Linear layers. | |
| - Compute: BF16. | |
| - BF16: first/last four language layers, cross-attention projections, vision encoder/merger, embeddings, norms and `lm_head`. | |
| - KV cache: BF16 (`KV16`); HQQ KV8 is not enabled. | |
| - SGLang compatibility is not claimed for this checkpoint. | |