| license: gemma | |
| base_model: google/gemma-4-e4b-it | |
| tags: | |
| - quantized | |
| - gguf | |
| - candle | |
| - q8_0 | |
| # gemma-4-e4b-it — Q8_0 weight cache + auxiliary tensors | |
| Quantized deployment artifacts for [google/gemma-4-e4b-it](https://huggingface.co/google/gemma-4-e4b-it). | |
| - `qcache-q8_0.v1.gguf` — GGML **Q8_0** tensors for the model's linear projections, | |
| stored in a GGUF container keyed by the original checkpoint tensor paths | |
| (no metadata KVs). Produced by in-memory quantization of the bf16 | |
| checkpoint with a [candle](https://github.com/huggingface/candle)-based | |
| loader. | |
| - `aux-tensors.safetensors` — everything the cache does not carry: | |
| embeddings, norms and other non-projection tensors, in their original | |
| dtypes. | |
| - Config and tokenizer files are copied unmodified from the base | |
| repository. | |
| **Format note**: this is *not* a llama.cpp-compatible GGUF — tensors keep | |
| their original checkpoint names and only linear projections are quantized. | |
| Load it with a runtime that pairs the cache with the auxiliary safetensors. | |
| Weights are redistributed under the same terms as the base model. | |