| Quantization made by Richard Erkhov. | |
| [Github](https://github.com/RichardErkhov) | |
| [Discord](https://discord.gg/pvy7H8DZMG) | |
| [Request more models](https://github.com/RichardErkhov/quant_request) | |
| tiny-random-GemmaForCausalLM - bnb 4bits | |
| - Model creator: https://huggingface.co/fxmarty/ | |
| - Original model: https://huggingface.co/fxmarty/tiny-random-GemmaForCausalLM/ | |
| Original model description: | |
| --- | |
| license: mit | |
| --- | |
| This one with a custom `config.head_dim` as allowed by the architecture (see 7b model). | |