phi-2-imatrix-gguf / README.md
ristew's picture
add perplexities data
e832081
[phi-2](https://huggingface.co/microsoft/phi-2) quantized using imatrix data from [kalomaze's groups_merged.txt](https://github.com/ggerganov/llama.cpp/files/14194570/groups_merged.txt)
Perplexities:
Q8_0: 5.3886
Q4_0: 5.5526
IQ3_XXS: 6.0745
IQ2_XS: 7.2570
IQ2_XXS: 9.3666
IQ1_S: 18.7885