File size: 3,769 Bytes
cdfd2c4 725806c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 | ---
license: apache-2.0
language:
- en
- multilingual
pipeline_tag: automatic-speech-recognition
tags:
- audio
- speech-recognition
- gguf
- gemma
- conformer
library_name: ggml
base_model: google/gemma-4-E4B-it
---
# Gemma-4-E4B-it — GGUF
GGUF conversion of [`google/gemma-4-E4B-it`](https://huggingface.co/google/gemma-4-E4B-it) for use with **[CrispStrobe/CrispASR](https://github.com/CrispStrobe/CrispASR)**.
E4B is the larger sibling of [`cstr/gemma4-e2b-it-GGUF`](https://huggingface.co/cstr/gemma4-e2b-it-GGUF): the **same `gemma4` architecture** (byte-identical 1024-dim USM Conformer audio tower) with a larger decoder. It runs on the same CrispASR backend with no code changes.
> The Gemma-4 **12B** model is a *different* architecture (`gemma4_unified`, 640-dim audio encoder) and is **not** supported by this backend.
## Available variants
| File | Quant | Size | Notes |
|---|---|---|---|
| `gemma4-e4b-it-f16.gguf` | F16 | ~14.6 GB | Full precision |
| `gemma4-e4b-it-q8_0.gguf` | Q8_0 | ~7.8 GB | Near-lossless quant |
| `gemma4-e4b-it-q4_k.gguf` | Q4_K | ~4.1 GB | Standard quant (auto-download default) |
## Model details
- **Architecture:** USM Conformer audio encoder (12L, 1024d, chunked-local attention with relative position bias, LightConv1d, ClippableLinear with QAT scalars) + Gemma4 LLM decoder (42L, 2560d, GQA 8Q/2KV, per-layer embeddings, hybrid sliding/full attention, GeGLU)
- **Parameters:** ~4B effective (~8B with embeddings)
- **Audio:** Gemma4AudioFeatureExtractor — 128-bin mel, 16 kHz, frame_length=320, hop=160, fft_length=512, semicausal padding, log(mel + mel_floor=0.001), no normalisation
- **Languages:** 140+ (ASR + speech translation)
- **License:** Apache 2.0
- **Source:** [`google/gemma-4-E4B-it`](https://huggingface.co/google/gemma-4-E4B-it)
## Usage
```bash
# Auto-download the Q4_K default and transcribe:
crispasr -m gemma4-e4b --auto-download -f audio.wav
# Or point at a local file (backend auto-detected from the GGUF):
crispasr --backend gemma4-e2b -m gemma4-e4b-it-q4_k.gguf -f audio.wav
```
The CrispASR backend is named `gemma4-e2b` (it serves the whole `gemma4` E2B/E4B family).
## What's included vs an upstream Gemma-4 GGUF
This GGUF is built specifically for ASR with CrispASR and includes the audio path that standard text/vision Gemma-4 GGUFs omit:
- 12-layer audio conformer encoder.
- Gemma4MultimodalEmbedder audio→LLM adapter (`embed_audio.embedding_projection`, pre-projection RMSNorm).
- Mel filterbank + Hann window baked into the GGUF.
Converted with [`models/convert-gemma4-e2b-to-gguf.py`](https://github.com/CrispStrobe/CrispASR/blob/main/models/convert-gemma4-e2b-to-gguf.py).
## Provenance and EU AI Act Art. 53 note
- **Upstream model:** [google/gemma-4-E4B-it](https://huggingface.co/google/gemma-4-E4B-it) — published by `google`.
- **Upstream licence:** `apache-2.0`. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
- **What was done here:** format conversion and/or quantisation only (GGUF/GGML). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
- **Training data:** documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
- **Provider status:** under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.
|