gguf-org
/

quant-type

Model card Files Files and versions

4.97 MB

Ctrl+K

Ctrl+K

2 contributors

History: 19 commits

calcuis's picture

Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf

2a76016 verified 10 months ago

.gitattributes

2.45 kB
Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf 10 months ago
README.md

88 Bytes
Update README.md 10 months ago
i-quant-iq3_s.gguf

254 kB
xet

Upload i-quant-iq3_s.gguf with huggingface_hub 10 months ago
i-quant-iq3_xxs.gguf

226 kB
xet

Upload i-quant-iq3_xxs.gguf with huggingface_hub 10 months ago
i-quant-iq4_nl.gguf

332 kB
xet

Upload i-quant-iq4_nl.gguf with huggingface_hub 10 months ago
i-quant-iq4_xs.gguf

314 kB
xet

Upload i-quant-iq4_xs.gguf with huggingface_hub 10 months ago
k-quant-q2_k.gguf

194 kB
xet

Upload k-quant-q2_k.gguf with huggingface_hub 10 months ago
k-quant-q3_k_m.gguf

254 kB
xet

Rename k-quant-q3_k.gguf to k-quant-q3_k_m.gguf 10 months ago
k-quant-q4_k_m.gguf

332 kB
xet

Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf 10 months ago
k-quant-q5_k_m.gguf

406 kB
xet

Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf 10 months ago
k-quant-q6_k.gguf

484 kB
xet

Upload k-quant-q6_k.gguf with huggingface_hub 10 months ago
s-quant-q4_0.gguf

332 kB
xet

Upload s-quant-q4_0.gguf with huggingface_hub 10 months ago
s-quant-q4_1.gguf

369 kB
xet

Upload s-quant-q4_1.gguf with huggingface_hub 10 months ago
s-quant-q5_0.gguf

406 kB
xet

Upload s-quant-q5_0.gguf with huggingface_hub 10 months ago
s-quant-q5_1.gguf

443 kB
xet

Upload s-quant-q5_1.gguf with huggingface_hub 10 months ago
s-quant-q8_0.gguf

627 kB
xet

Upload s-quant-q8_0.gguf with huggingface_hub 10 months ago