How to use AXERA-TECH/Qwen2.5-0.5B-Instruct-CTX-Int8 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AXERA-TECH/Qwen2.5-0.5B-Instruct-CTX-Int8", dtype="auto")
