| | ---
|
| | library_name: transformers
|
| | language:
|
| | - en
|
| | - fr
|
| | - it
|
| | - pt
|
| | - hi
|
| | - es
|
| | - th
|
| | - de
|
| | base_model:
|
| | - microsoft/phi-4
|
| | base_model_relation: quantized
|
| | quantized_by: tssst
|
| | pipeline_tag: text-generation
|
| | ---
|
| |
|
| | ## This repo contains EXL2 quants of microsoft/phi-4.
|
| |
|
| | Find the original model card [here](https://huggingface.co/microsoft/phi-4).
|
| |
|
| | ## Base repo only contains the measurement file, see revisions for the quants.
|
| |
|
| | - [measurement.json](https://huggingface.co/{REPO_NAME}/tree/main)
|
| | - [3bpw](https://huggingface.co/tssst/phi-4-exl2/tree/3bpw)
|
| | - [4bpw](https://huggingface.co/tssst/phi-4-exl2/tree/4bpw)
|
| | - [5bpw](https://huggingface.co/tssst/phi-4-exl2/tree/5bpw)
|
| | - [6bpw](https://huggingface.co/tssst/phi-4-exl2/tree/6bpw) |
