| base_model: | |
| - wheattoast11/utopia-atomic | |
| license: gemma | |
| tags: | |
| - bnb-my-repo | |
| # wheattoast11/utopia-atomic (Quantized) | |
| ## Description | |
| This model is a quantized version of the original model [`wheattoast11/utopia-atomic`](https://huggingface.co/wheattoast11/utopia-atomic). | |
| It's quantized using the BitsAndBytes library to 4-bit using the [bnb-my-repo](https://huggingface.co/spaces/bnb-community/bnb-my-repo) space. | |
| ## Quantization Details | |
| - **Quantization Type**: int4 | |
| - **bnb_4bit_quant_type**: fp4 | |
| - **bnb_4bit_use_double_quant**: True | |
| - **bnb_4bit_compute_dtype**: bfloat16 | |
| - **bnb_4bit_quant_storage**: uint8 | |