metadata
license: apache-2.0
base_model:
- mistralai/Mistral-Nemo-Instruct-2407
tags:
- nvfp4
Quantized NVFP4 version of Mistral-Nemo-Instruct-2407 with the down_proj tensors calibrated in FP8_DYNAMIC, created to compare against my hybrid quant. Made with the same version of llm-compressor and compressed-tensors, using the same calibration data, to isolate the variables as much as possible.