File size: 649 Bytes
685e343 58bab37 685e343 ca67294 685e343 ca67294 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | ---
license: cc-by-nc-4.0
base_model:
- CohereLabs/command-a-translate-08-2025
pipeline_tag: text-generation
datasets:
- NeelNanda/pile-10k
tags:
- autoround
---
W4A16 GPTQ quantized version of [CohereLabs/command-a-translate-08-2025](https://huggingface.co/CohereLabs/command-a-translate-08-2025)
Using [intel/auto-round](https://github.com/intel/auto-round) version: git+7b8e280
#### Generation command-line
```sh
auto-round --model command-a-translate --scheme "W4A16" --format "auto_gptq" --dataset 'NeelNanda/pile-10k:apply_chat_template:system_prompt="Translate following sentences into Korean and Japanese:"' --output_dir "./cat_gptq"
``` |