metadata
license: apache-2.0
base_model:
- mistralai/Mistral-Nemo-Instruct-2407
tags:
- nvfp4
Quantized NVFP4 version of Mistral-Nemo-Instruct-2407, created to be used as a baseline to compare against my hybrid quant. Made with the same version of llm-compressor and compressed-tensors, using the same calibration data, to isolate the variables as much as possible.