Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
xaskasdf
/
phi-3-medium-4k-instruct-gguf
like
0
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
phi-3-medium-4k-instruct-gguf
180 GB
1 contributor
History:
5 commits
xaskasdf
Upload q3, q2 quantized model weights
0030274
verified
over 1 year ago
.gitattributes
2.82 kB
Upload q3, q2 quantized model weights
over 1 year ago
Phi-3-medium-4k-instruct-Q2_K.gguf
5.34 GB
xet
Upload q3, q2 quantized model weights
over 1 year ago
Phi-3-medium-4k-instruct-Q3_K.gguf
7.12 GB
xet
Upload q3, q2 quantized model weights
over 1 year ago
Phi-3-medium-4k-instruct-Q3_K_L.gguf
7.68 GB
xet
Upload q3, q2 quantized model weights
over 1 year ago
Phi-3-medium-4k-instruct-Q3_K_S.gguf
6.26 GB
xet
Upload q3, q2 quantized model weights
over 1 year ago
Phi-3-medium-4k-instruct-Q4_0.gguf
8.09 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_0_4_4.gguf
8.09 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_0_4_8.gguf
8.09 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_0_8_8.gguf
8.09 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_1.gguf
8.95 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_K.gguf
8.76 GB
xet
Upload q4 models
over 1 year ago
Phi-3-medium-4k-instruct-Q4_K_S.gguf
8.15 GB
xet
Upload q4, q5, q6 quantized weights
over 1 year ago
Phi-3-medium-4k-instruct-Q5_0.gguf
9.82 GB
xet
Upload q4, q5, q6 quantized weights
over 1 year ago
Phi-3-medium-4k-instruct-Q5_1.gguf
10.7 GB
xet
Upload q4, q5, q6 quantized weights
over 1 year ago
Phi-3-medium-4k-instruct-Q5_K.gguf
10.3 GB
xet
Upload q4, q5, q6 quantized weights
over 1 year ago
Phi-3-medium-4k-instruct-Q5_K_S.gguf
9.82 GB
xet
Upload converted model weight and q5,q8 quants
over 1 year ago
Phi-3-medium-4k-instruct-Q6_K.gguf
11.6 GB
xet
Upload q4, q5, q6 quantized weights
over 1 year ago
Phi-3-medium-4k-instruct-Q8_0.gguf
15 GB
xet
Upload converted model weight and q5,q8 quants
over 1 year ago
Phi-3-medium-4k-instruct-f16.gguf
27.9 GB
xet
Upload converted model weight and q5,q8 quants
over 1 year ago
