Instructions to use AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K
- qwen2.5_tokenizer
- 1.72 kB
- 11.5 kB
- 627 Bytes
- 999 kB xet
- 1.02 MB xet
- 954 kB xet
- 1.09 GB xet
- 277 Bytes
- 4.36 kB
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 136 MB xet
- 594 MB xet
- 1.61 MB
- 587 Bytes
- 592 Bytes
- 588 Bytes