elysiantech
/

phi-3-mini-4k-instruct-GGUF

Model card Files Files and versions

phi-3-mini-4k-instruct-GGUF

22.5 GB

1 contributor

History: 6 commits

elysiantech's picture

Quantized with llama.cpp

654b6fa verified over 1 year ago

.gitattributes

1.86 kB

Quantized with llama.cpp over 1 year ago
phi-3-mini-4k-instruct-F16.gguf

7.64 GB
xet

Quantized with llama.cpp over 1 year ago
phi-3-mini-4k-instruct-Q3_K_M.gguf

1.96 GB
xet

Quantized with llama.cpp over 1 year ago
phi-3-mini-4k-instruct-Q4_K_M.gguf

2.39 GB
xet

Quantized with llama.cpp over 1 year ago
phi-3-mini-4k-instruct-Q5_K_M.gguf

2.82 GB
xet

Quantized with llama.cpp over 1 year ago
phi-3-mini-4k-instruct.gguf

7.64 GB
xet

Converted with llama.cpp over 1 year ago