| base_model: | |
| - medmekk/testing_4 | |
| # medmekk/testing_4 (Quantized) | |
| ## Description | |
| This model is a quantized version of the original model `medmekk/testing_4`. It has been quantized using int4 quantization with bitsandbytes. | |
| ## Quantization Details | |
| - **Quantization Type**: int4 | |
| - **bnb_4bit_quant_type**: nf4 | |
| - **bnb_4bit_use_double_quant**: True | |
| - **bnb_4bit_compute_dtype**: bfloat16 | |
| - **bnb_4bit_quant_storage**: uint8 | |
| ## Usage | |
| You can use this model in your applications by loading it directly from the Hugging Face Hub: | |
| ```python | |
| from transformers import AutoModel | |
| model = AutoModel.from_pretrained("medmekk/testing_4") |