metadata
base_model:
- google/gemma-4-E4B-it
pipeline_tag: any-to-any
tags:
- onnx
Gemma-4-E4B-IT ONNX export
Required Packages
- Mobius (main) - Install from source using
pip install -e . - Olive (main) - Install from source using
pip install -e . - Olive-recipe (main) - Run the recipe: https://github.com/microsoft/olive-recipes/tree/main/google-gemma-4-E2B-it
- Change the input model name to gemma-4-E2B-it
Quantization
- K-quant
- Group size 32