| --- |
| license: gemma |
| base_model: google/gemma-4-E2B-it-qat-q4_0-unquantized |
| tags: |
| - mlx |
| - vision |
| - gemma4 |
| - image-text-to-text |
| library_name: mlx |
| --- |
| |
| # Rytability Gemma 4 Vision Tower |
|
|
| The vision tower for Rytability's Gemma 4 E2B model, published as a separate |
| download so the app can ship the text weights alone and fetch image support |
| only for users who want it. |
|
|
| | | | |
| |---|---| |
| | File | `model-vision.safetensors` | |
| | Size | 337,171,954 bytes | |
| | Tensors | 659 (`vision_tower.*`, `embed_vision.*`) | |
| | Precision | BF16 (unquantized) | |
| | sha256 | `5b322b050d1f32f0d52203376c04dfe1fbbcd5e41f743d10cf0febf273fec293` | |
| | Source | `google/gemma-4-E2B-it-qat-q4_0-unquantized` | |
|
|
| ## Why BF16 |
|
|
| The tower is downloaded rather than bundled, so it does not count against the |
| app's on-device size budget. Keeping it at full precision is close to free and |
| it matters for OCR quality: quantizing to 4-bit costs roughly 17 points of OCR |
| accuracy to save about 220 MB, which is a bad trade for an app whose scanning |
| feature reads receipts, handwriting and notes. |
|
|
| ## Not interchangeable with the Gemma 3 tower |
|
|
| Gemma 4's vision tower is a different architecture with different tensor names |
| and shapes. It cannot be paired with Gemma 3 text weights, and Gemma 3 vision |
| weights cannot be paired with Gemma 4 text weights. The two halves of a model |
| must be swapped together. |
|
|
| ## Usage |
|
|
| The file is loaded alongside matching Gemma 4 E2B text weights in a single |
| directory; MLX reads every `*.safetensors` in that directory as one model. |
|
|
| ## License |
|
|
| Gemma Terms of Use: https://ai.google.dev/gemma/terms |
|
|
