179 GB

1 contributor

History: 24 commits

eaddario

Update README.md

a5f810a verified 5 months ago

imatrix
Generate imatrices 6 months ago
logits
Generate base model logits 6 months ago
scores
Add GGUF internal file structure 6 months ago
.gitattributes

1.6 kB

Update .gitattributes 6 months ago
.gitignore

6.78 kB

Add .gitignore 6 months ago
README.md

22.5 kB

Update README.md 5 months ago
gemma-3-12b-it-F16.gguf

23.5 GB
xet

Convert safetensor to GGUF @ F16 6 months ago
gemma-3-12b-it-pruned-IQ3_M.gguf

5.21 GB
xet

Layer-wise & pruned quantization IQ3_M 6 months ago
gemma-3-12b-it-pruned-IQ3_S.gguf

5.04 GB
xet

Layer-wise & pruned quantization IQ3_S 6 months ago
gemma-3-12b-it-pruned-IQ4_NL.gguf

6.16 GB
xet

Layer-wise & pruned quantization IQ4_NL 6 months ago
gemma-3-12b-it-pruned-Q3_K_L.gguf

5.33 GB
xet

Layer-wise & pruned quantization Q3_K_L 6 months ago
gemma-3-12b-it-pruned-Q3_K_M.gguf

5.04 GB
xet

Layer-wise & pruned quantization Q3_K_M 6 months ago
gemma-3-12b-it-pruned-Q3_K_S.gguf

4.81 GB
xet

Layer-wise & pruned quantization Q3_K_S 6 months ago
gemma-3-12b-it-pruned-Q4_K_M.gguf

6.2 GB
xet

Layer-wise & pruned quantization Q4_K_M 6 months ago
gemma-3-12b-it-pruned-Q4_K_S.gguf

6.17 GB
xet

Layer-wise & pruned quantization Q4_K_S 6 months ago
gemma-3-12b-it-pruned-Q5_K_M.gguf

7.32 GB
xet

Layer-wise & pruned quantization Q5_K_M 6 months ago
gemma-3-12b-it-pruned-Q5_K_S.gguf

7.26 GB
xet

Layer-wise & pruned quantization Q5_K_S 6 months ago
gemma-3-12b-it-pruned-Q6_K.gguf

9.01 GB
xet

Layer-wise & pruned quantization Q6_K 6 months ago
gemma-3-12b-it-pruned-Q8_0.gguf

11 GB
xet

Layer-wise & pruned quantization Q8_0 6 months ago