--- license: cc-by-nc-4.0 base_model: - CohereLabs/command-a-translate-08-2025 pipeline_tag: text-generation datasets: - NeelNanda/pile-10k tags: - autoround --- W4A16 GPTQ quantized version of [CohereLabs/command-a-translate-08-2025](https://huggingface.co/CohereLabs/command-a-translate-08-2025) Using [intel/auto-round](https://github.com/intel/auto-round) version: git+7b8e280 #### Generation command-line ```sh auto-round --model command-a-translate --scheme "W4A16" --format "auto_gptq" --dataset 'NeelNanda/pile-10k:apply_chat_template:system_prompt="Translate following sentences into Korean and Japanese:"' --output_dir "./cat_gptq" ```