README.md

---

library_name: transformers
language:
- en
- fr
- it
- pt
- hi
- es
- th
- de
base_model:
- microsoft/phi-4
base_model_relation: quantized
quantized_by: tssst
pipeline_tag: text-generation
---


## This repo contains EXL2 quants of microsoft/phi-4.

Find the original model card [here](https://huggingface.co/microsoft/phi-4).

## Base repo only contains the measurement file, see revisions for the quants.

- [measurement.json](https://huggingface.co/{REPO_NAME}/tree/main)
- [3bpw](https://huggingface.co/tssst/phi-4-exl2/tree/3bpw)
- [4bpw](https://huggingface.co/tssst/phi-4-exl2/tree/4bpw)
- [5bpw](https://huggingface.co/tssst/phi-4-exl2/tree/5bpw)
- [6bpw](https://huggingface.co/tssst/phi-4-exl2/tree/6bpw)