llama.cpp and ik_llama.cpp imatrix Quantizations of unsloth/phi-4-GGUF
Imatrix and quantizations created from https://huggingface.co/unsloth/phi-4-GGUF/phi-4-F16.gguf
Imatrix dataset from bartowski1182
llama.cpp
phi-4-IQ2_S.gguf
phi-4-IQ3_XS.gguf
phi-4-Q4_K_M.gguf
phi-4-IQ4_XS.gguf
phi-4-IQ4_NL.gguf
ik_llama.cpp
phi-4-IQ4_KS.gguf
phi-4-IQ4_NL_R4.gguf
Credits
llama.cpp, ik_llama.cpp, bartowski, microsoft, unsloth, huggingface
- Downloads last month
- 6
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for mcm07/phi-4-GGUF-imatrix
Base model
microsoft/phi-4