vllmd
/

gemma-3-4b-it-w8a8

8-bit precision

compressed-tensors

Model card Files Files and versions

gemma-3-4b-it-w8a8

6.77 GB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

stevendake's picture

Introduce quantized Google Gemma 3-4b instruction tuned

a10c93a over 1 year ago

chat_template.json

1.62 kB
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
config.json

13.5 kB
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
generation_config.json

192 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
model-00001-of-00002.safetensors

4.99 GB
xet

Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
model-00002-of-00002.safetensors

1.75 GB
xet

Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
model.safetensors.index.json

115 kB
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
preprocessor_config.json

570 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
processor_config.json

70 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
quantization_info.txt

268 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
recipe.yaml

254 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
special_tokens_map.json

662 Bytes
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
tokenizer.json

33.4 MB
xet

Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago
tokenizer_config.json

1.16 MB
Introduce quantized Google Gemma 3-4b instruction tuned over 1 year ago