README.md

Quantization made by Richard Erkhov.

Github

Discord

Request more models

tiny-random-GemmaForCausalLM - bnb 4bits

• Model creator: https://huggingface.co/fxmarty/
• Original model: https://huggingface.co/fxmarty/tiny-random-GemmaForCausalLM/

Original model description:

license: mit

This one with a custom config.head_dim as allowed by the architecture (see 7b model).