l3utterfly
/

phi-3-mini-128k-instruct-gguf

Model card Files Files and versions

phi-3-mini-128k-instruct-gguf

25.6 GB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

l3utterfly's picture

Add quantised GGUF files

e201c84 over 1 year ago

.gitattributes

1.56 kB
cradle almost 2 years ago
Phi-3-mini-128k-instruct-Q2_K.gguf

1.42 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-Q3_K.gguf

1.96 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-Q4_0.gguf

2.18 GB
xet

Add quantised GGUF files over 1 year ago
Phi-3-mini-128k-instruct-Q4_K.gguf

2.39 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-Q5_K.gguf

2.82 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-Q6_K.gguf

3.14 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-Q8_0.gguf

4.06 GB
xet

updated model to latest llama.cpp almost 2 years ago
Phi-3-mini-128k-instruct-f16.gguf

7.64 GB
xet

Add quantised GGUF files over 1 year ago
README.md

21 Bytes
initial commit almost 2 years ago