optimum-cli export openvino --model unsloth/gemma-3-4b-it --scale-estimation --ratio 0.9 --weight-format int4 --backup-precision int8_asym --dataset contextual --quant-mode int4_f8e4m3 gemma-3-4b-it-ov-int4
- Downloads last month
- 2
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support