task-aware-llm-council
/

gemma-2-9b-it-AWQ

compressed-tensors

Model card Files Files and versions

gemma-2-9b-it-AWQ

6.29 GB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

mbhaskar98's picture

Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor

8f0dc08 verified 4 months ago

.gitattributes
1.57 kB
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
chat_template.jinja
591 Bytes
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
config.json
2.8 kB
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
generation_config.json
168 Bytes
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
model-00001-of-00002.safetensors
4.99 GB
xet

Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
model-00002-of-00002.safetensors
1.26 GB
xet

Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
model.safetensors.index.json
92.4 kB
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
recipe.yaml
1.26 kB
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
special_tokens_map.json
636 Bytes
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
tokenizer.json
34.4 MB
xet

Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago
tokenizer_config.json
46.4 kB
Upload AWQ 4-bit quantization of google/gemma-2-9b-it via llm-compressor 4 months ago