Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,9 @@ tags:
|
|
| 8 |
|
| 9 |
This model is a mixed int4 model with group_size 128 and asymmetric quantization of [zai-org/GLM-5](https://huggingface.co/zai-org/GLM-5/) generated by [intel/auto-round](https://github.com/intel/auto-round). Please follow the license of the original model.
|
| 10 |
|
| 11 |
-
**The model is quantized with pure RTN mode**
|
|
|
|
|
|
|
| 12 |
|
| 13 |
## vllm inference
|
| 14 |
|
|
|
|
| 8 |
|
| 9 |
This model is a mixed int4 model with group_size 128 and asymmetric quantization of [zai-org/GLM-5](https://huggingface.co/zai-org/GLM-5/) generated by [intel/auto-round](https://github.com/intel/auto-round). Please follow the license of the original model.
|
| 10 |
|
| 11 |
+
**The model is quantized with pure RTN mode**.
|
| 12 |
+
|
| 13 |
+
**Some users have reported unexpected outputs with this model. Please use it with caution for now. We will try to investigate the root cause and release an updated version later.**
|
| 14 |
|
| 15 |
## vllm inference
|
| 16 |
|