srgaddam's picture
Upload folder using huggingface_hub
f40a829 verified
|
Raw
History Blame Contribute Delete
468 Bytes
---
base_model:
- google/gemma-4-E4B-it
pipeline_tag: any-to-any
tags:
- onnx
---
# Gemma-4-E4B-IT ONNX export
## Required Packages
- Mobius (main) - Install from source using `pip install -e .`
- Olive (main) - Install from source using `pip install -e .`
- Olive-recipe (main) - Run the recipe: https://github.com/microsoft/olive-recipes/tree/main/google-gemma-4-E2B-it
- Change the input model name to gemma-4-E2B-it
## Quantization
- K-quant
- Group size 32