exolabs
/

gemma-4-e2b-it-8bit-text-dequant-bf16

Model card Files Files and versions

gemma-4-e2b-it-8bit-text-dequant-bf16

9.29 GB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

dmcc73's picture

Restore shared KV norm weights for vLLM

f896bd6 verified about 1 month ago

.gitattributes

1.57 kB
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
README.md

470 Bytes
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
chat_template.jinja

17.3 kB
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
config.json

2.22 kB
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
generation_config.json

208 Bytes
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
hf_upload_request.json

294 Bytes
Restore shared KV norm weights for vLLM about 1 month ago
hf_upload_response.json

135 Bytes
Restore shared KV norm weights for vLLM about 1 month ago
mlx_to_vllm_export.json

1.38 kB
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
model-00001-of-00002.safetensors

4.53 GB
xet

Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
model-00002-of-00002.safetensors

4.73 GB
xet

Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
model-shared-kv-norms.safetensors

14.3 kB
xet

Restore shared KV norm weights for vLLM about 1 month ago
model.safetensors.index.json

47.1 kB
Restore shared KV norm weights for vLLM about 1 month ago
shared_kv_norm_restore.json

1.29 kB
Restore shared KV norm weights for vLLM about 1 month ago
tokenizer.json

32.2 MB
xet

Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago
tokenizer_config.json

2.77 kB
Upload gemma-4-e2b-it-8bit dequantized BF16 export about 1 month ago