gemma-2b-trader-8bit / quantization_config.json
Wezenite's picture
Upload folder using huggingface_hub
e3b5b8d verified
{
"quantization_method": "bitsandbytes",
"bits": 8,
"load_in_8bit": true,
"llm_int8_threshold": 6.0
}