249 GB

1 contributor

History: 2 commits

bartowski

Llamacpp quants

f68fdd7 verified over 1 year ago

Codestral-RAG-19B-Pruned-f32.gguf
Llamacpp quants over 1 year ago
.gitattributes

3.06 kB

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ2_M.gguf

6.56 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ2_S.gguf

6.06 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ2_XS.gguf

5.73 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ3_M.gguf

8.66 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ3_XS.gguf

7.9 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ3_XXS.gguf

7.4 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-IQ4_XS.gguf

10.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q2_K.gguf

7.12 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q3_K_L.gguf

10.1 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q3_K_M.gguf

9.26 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q3_K_S.gguf

8.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q4_K_M.gguf

11.5 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q4_K_S.gguf

10.9 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q5_K_M.gguf

13.5 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q5_K_S.gguf

13.2 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q6_K.gguf

15.7 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned-Q8_0.gguf

20.3 GB
xet

Llamacpp quants over 1 year ago
Codestral-RAG-19B-Pruned.imatrix

10.2 MB
xet

Llamacpp quants over 1 year ago
README.md

7.32 kB

Llamacpp quants over 1 year ago