File size: 468 Bytes
6aa69e9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f40a829
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
base_model:
- google/gemma-4-E4B-it
pipeline_tag: any-to-any
tags:
- onnx
---

# Gemma-4-E4B-IT ONNX export

## Required Packages

- Mobius (main) - Install from source using `pip install -e .`
- Olive (main) - Install from source using `pip install -e .`
- Olive-recipe (main) - Run the recipe: https://github.com/microsoft/olive-recipes/tree/main/google-gemma-4-E2B-it
  - Change the input model name to gemma-4-E2B-it

## Quantization

- K-quant
- Group size 32