--- library_name: transformers language: - en - fr - it - pt - hi - es - th - de base_model: - microsoft/phi-4 base_model_relation: quantized quantized_by: tssst pipeline_tag: text-generation --- ## This repo contains EXL2 quants of microsoft/phi-4. Find the original model card [here](https://huggingface.co/microsoft/phi-4). ## Base repo only contains the measurement file, see revisions for the quants. - [measurement.json](https://huggingface.co/{REPO_NAME}/tree/main) - [3bpw](https://huggingface.co/tssst/phi-4-exl2/tree/3bpw) - [4bpw](https://huggingface.co/tssst/phi-4-exl2/tree/4bpw) - [5bpw](https://huggingface.co/tssst/phi-4-exl2/tree/5bpw) - [6bpw](https://huggingface.co/tssst/phi-4-exl2/tree/6bpw)