Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
xaskasdf
/
phi-3-medium-128k-instruct-gguf
like
0
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
No model card
Downloads last month
48
GGUF
Model size
14B params
Architecture
phi3
Chat template
Hardware compatibility
Log In
to add your hardware
1-bit
IQ1_S
3.17 GB
IQ1_M
3.46 GB
2-bit
IQ2_XXS
3.93 GB
IQ2_XS
4.34 GB
IQ2_S
4.55 GB
Q2_K_S
4.96 GB
Q2_K
5.34 GB
IQ2_M
4.93 GB
3-bit
IQ3_XXS
5.67 GB
IQ3_XS
6 GB
IQ3_S
6.26 GB
Q3_K_S
6.26 GB
IQ3_M
6.67 GB
Q3_K_L
7.68 GB
4-bit
IQ4_XS
7.66 GB
Q4_K_S
8.15 GB
IQ4_NL
8.09 GB
Q4_0
8.09 GB
Q4_0
8.09 GB
Q4_0
8.09 GB
Q4_0
8.09 GB
Q4_1
8.95 GB
5-bit
Q5_K_S
9.82 GB
Q5_0
9.82 GB
Q5_1
10.7 GB
6-bit
Q6_K
11.6 GB
8-bit
Q8_0
15 GB
16-bit
F16
27.9 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Collection including
xaskasdf/phi-3-medium-128k-instruct-gguf
phi-3
Collection
Microsoft's Phi-3 models in gguf format
•
5 items
•
Updated
Sep 11, 2024