hell0ks's picture
Update README.md
58bab37 verified
metadata
license: cc-by-nc-4.0
base_model:
  - CohereLabs/command-a-translate-08-2025
pipeline_tag: text-generation
datasets:
  - NeelNanda/pile-10k
tags:
  - autoround

W4A16 GPTQ quantized version of CohereLabs/command-a-translate-08-2025

Using intel/auto-round version: git+7b8e280

Generation command-line

auto-round --model command-a-translate --scheme "W4A16" --format "auto_gptq" --dataset 'NeelNanda/pile-10k:apply_chat_template:system_prompt="Translate following sentences into Korean and Japanese:"' --output_dir "./cat_gptq"