AXERA-TECH
/

Qwen3-4B-Instruct-2507-GPTQ-Int8

Text Generation

Model card Files Files and versions

Qwen3-4B-Instruct-2507-GPTQ-Int8

5.95 GB

1 contributor

History: 7 commits

wli1995's picture

Update run_qwen3_4b_int8_gptq_axcl_x86.sh

b334419 verified about 1 month ago

Qwen3-4B-Instruct-2507-GPTQ-Int8-context-4k-prefill-3584
Upload folder using huggingface_hub about 1 month ago
qwen2.5_tokenizer
Upload folder using huggingface_hub about 1 month ago
qwen3_tokenizer
Upload folder using huggingface_hub about 1 month ago
.gitattributes
1.95 kB

Upload folder using huggingface_hub about 1 month ago
README.md
6.63 kB

Upload folder using huggingface_hub about 1 month ago
config.json
0 Bytes

Upload folder using huggingface_hub about 1 month ago
main_api_ax650
1.13 MB
xet

Upload folder using huggingface_hub about 1 month ago
main_api_axcl_aarch64
1.85 MB
xet

Upload folder using huggingface_hub about 1 month ago
main_api_axcl_x86
1.95 MB
xet

Upload folder using huggingface_hub about 1 month ago
main_ax650
1.02 MB
xet

Upload folder using huggingface_hub about 1 month ago
main_axcl_aarch64
1.72 MB
xet

Upload folder using huggingface_hub about 1 month ago
main_axcl_x86
1.84 MB
xet

Upload folder using huggingface_hub about 1 month ago
post_config.json
277 Bytes

Upload folder using huggingface_hub about 1 month ago
qwen3_tokenizer_uid.py
7.77 kB

Upload folder using huggingface_hub about 1 month ago
run_qwen3_4b_int8_gptq_ax650.sh
2.56 kB

Upload folder using huggingface_hub about 1 month ago
run_qwen3_4b_int8_gptq_ax650_api.sh
2.54 kB

Upload folder using huggingface_hub about 1 month ago
run_qwen3_4b_int8_gptq_axcl_aarch64.sh
2.58 kB

Upload folder using huggingface_hub about 1 month ago
run_qwen3_4b_int8_gptq_axcl_x86.sh
2.63 kB

Update run_qwen3_4b_int8_gptq_axcl_x86.sh about 1 month ago
run_qwen3_4b_int8_gptq_axcl_x86_api.sh
2.56 kB

Upload folder using huggingface_hub about 1 month ago