xaskasdf
/

phi-3-mini-4k-instruct-gguf

Model card Files Files and versions

phi-3-mini-4k-instruct-gguf

61.6 GB

1 contributor

History: 4 commits

xaskasdf's picture

Upload extended quantizations

c345b8e verified over 1 year ago

.gitattributes
2.76 kB

Upload extended quantizations over 1 year ago
phi-3-mini-4k-instruct-bf16.gguf
7.64 GB
xet

Upload extended quantizations over 1 year ago
phi-3-mini-4k-instruct-f16.gguf
7.64 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-f32.gguf
15.1 GB
xet

Upload extended quantizations over 1 year ago
phi-3-mini-4k-instruct-iq2_m.gguf
1.45 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-iq2_s.gguf
1.35 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-iq2_xs.gguf
1.28 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-iq2_xxs.gguf
1.17 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-iq4_nl.gguf
2.29 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-iq4_xs.gguf
2.18 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-q2_k.gguf
1.53 GB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago
phi-3-mini-4k-instruct-q3_k.gguf
2.07 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q4_0.gguf
2.29 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q4_k.gguf
2.51 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q5_0.gguf
2.76 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q5_k.gguf
2.93 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q6_k.gguf
3.25 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k-instruct-q8_0.gguf
4.15 GB
xet

Upload converted and quantized model weights over 1 year ago
phi-3-mini-4k.imatrix
2.23 MB
xet

Upload importance matrix, heavily quantized model weights and q2 over 1 year ago