|
|
--- |
|
|
license: mit |
|
|
language: |
|
|
- en |
|
|
- zh |
|
|
pipeline_tag: text-generation |
|
|
library_name: exllamav3 |
|
|
base_model: zai-org/GLM-4.5 |
|
|
base_model_relation: quantized |
|
|
tags: |
|
|
- exl3 |
|
|
--- |
|
|
|
|
|
exllamav3 quantizations of [zai-org/GLM-4.5](https://huggingface.co/zai-org/GLM-4.5). |
|
|
|
|
|
[2.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/2.00bpw_H6_Revised) 84.517 GiB |
|
|
[3.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/3.00bpw_H6_Revised) 125.398 GiB |
|
|
[4.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/4.00bpw_H6_Revised) 166.280 GiB |
|
|
[5.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/5.00bpw_H6_Revised) 207.162 GiB |
|
|
[6.00 bpw h6](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/6.00bpw_H6_Revised) 248.043 GiB |
|
|
[8.00 bpw h8](https://huggingface.co/MikeRoz/GLM-4.5-exl3/tree/8.00bpw_H8_Revised) 329.987 GiB |
|
|
|
|
|
|
