plan.md

# Create space for quantizing models

## Download and Upload

Needs code for downloading model file from a repo on hugginface using huggingface_hub



Needs code for uploading quantized model to a target repo as a pull request using huggingface_hub

## Quantization options in UI

Source repo and filename for input model

Target repo and filename for output model


### Quant format options in UI

int8 rowwise(add -int8mixedrow-simple to output model name):
int8=True
scaling_mode="row"



mxfp8(add -mxfp8mixed-simple to output model name):

mxfp8=True



fp8(default and add -fp8mixed-simple to output model name):

scaling_mode="tensor"

## Layer filter options in UI

Anima:
anima=True

Microsoft Lens:
lens=True

Flux2:
flux2=True

Chroma:
distillation_large=True



Radiance:

nerf_large=True
radiance=True

WAN:
wan=True

LTX-2.x:
ltxv2=True

Qwen Image(should add high precision matmul option):
qwen=True
full_precision_matrix_mult=True



Z-Image:

zimage=True

zimage_refiner=True

Regular expression(String value should be free text input):
exclude-layers="(substring_1|substring_2|substring_3)"



## Always included



comfy_quant=True
save_quant_metadata=True
low_memory=True

simple=True

calib_samples=40960