File size: 380 Bytes
895ed25 cb1835a | 1 2 3 4 5 6 | ---
license: apache-2.0
---
This model is an int4 model with group_size 128 and symmetric quantization of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) generated by [intel/auto-round](https://github.com/intel/auto-round) algorithm.
⚠️ Important: This model is used for internal testing with VLLM. Please do not delete or modify without approval. |