QuantFactory
/

saiga_gemma2_9b-GGUF

Model card Files Files and versions

saiga_gemma2_9b-GGUF

84.7 GB

1 contributor

History: 16 commits

aashish1904's picture

Upload saiga_gemma2_9b.Q4_K_S.gguf with huggingface_hub

39901dc verified over 1 year ago

.gitattributes
2.4 kB

Upload saiga_gemma2_9b.Q4_K_S.gguf with huggingface_hub over 1 year ago
README.md
5.01 kB

Upload README.md with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q2_K.gguf
3.81 GB
xet

Upload saiga_gemma2_9b.Q2_K.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q3_K_L.gguf
5.13 GB
xet

Upload saiga_gemma2_9b.Q3_K_L.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q3_K_M.gguf
4.76 GB
xet

Upload saiga_gemma2_9b.Q3_K_M.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q3_K_S.gguf
4.34 GB
xet

Upload saiga_gemma2_9b.Q3_K_S.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q4_0.gguf
5.44 GB
xet

Upload saiga_gemma2_9b.Q4_0.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q4_1.gguf
5.96 GB
xet

Upload saiga_gemma2_9b.Q4_1.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q4_K_M.gguf
5.76 GB
xet

Upload saiga_gemma2_9b.Q4_K_M.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q4_K_S.gguf
5.48 GB
xet

Upload saiga_gemma2_9b.Q4_K_S.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q5_0.gguf
6.48 GB
xet

Upload saiga_gemma2_9b.Q5_0.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q5_1.gguf
7 GB
xet

Upload saiga_gemma2_9b.Q5_1.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q5_K_M.gguf
6.65 GB
xet

Upload saiga_gemma2_9b.Q5_K_M.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q5_K_S.gguf
6.48 GB
xet

Upload saiga_gemma2_9b.Q5_K_S.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q6_K.gguf
7.59 GB
xet

Upload saiga_gemma2_9b.Q6_K.gguf with huggingface_hub over 1 year ago
saiga_gemma2_9b.Q8_0.gguf
9.83 GB
xet

Upload saiga_gemma2_9b.Q8_0.gguf with huggingface_hub over 1 year ago