Hugging Face's logo

google
/
gemma-4-12B-it

Any-to-Any
Transformers
Safetensors
gemma4_unified
image-text-to-text
Eval Results
Model card Files
xet
 Community
20

NVFP4 / FP8 Quantizations

#19
by vincentzed-hf - opened
Discussion
vincentzed-hf

Unofficial-- feel free to try these!!
https://huggingface.co/AxionML/Gemma-4-12B-NVFP4
https://huggingface.co/AxionML/Gemma-4-12B-FP8
thnamratha
 Google org
•
edited about 2 hours ago

Hi @vincentzed-hf ,

Thank you so much for taking the time to provide these quantized versions. We truly appreciate your efforts on the potential for NVFP4 and FP8 quantized versions of Gemma-4-12B model.

Sign up or log in to comment