|
|
--- |
|
|
license: cc-by-nc-4.0 |
|
|
base_model: |
|
|
- CohereLabs/command-a-translate-08-2025 |
|
|
pipeline_tag: text-generation |
|
|
datasets: |
|
|
- NeelNanda/pile-10k |
|
|
tags: |
|
|
- autoround |
|
|
--- |
|
|
|
|
|
W4A16 GPTQ quantized version of [CohereLabs/command-a-translate-08-2025](https://huggingface.co/CohereLabs/command-a-translate-08-2025) |
|
|
|
|
|
Using [intel/auto-round](https://github.com/intel/auto-round) version: git+7b8e280 |
|
|
|
|
|
#### Generation command-line |
|
|
|
|
|
```sh |
|
|
auto-round --model command-a-translate --scheme "W4A16" --format "auto_gptq" --dataset 'NeelNanda/pile-10k:apply_chat_template:system_prompt="Translate following sentences into Korean and Japanese:"' --output_dir "./cat_gptq" |
|
|
``` |
