BechusRantus
/

injected_thinking

Model card Files Files and versions

injected_thinking / third_party /ms-swift /examples /export /quantize /mllm /bnb.sh

BechusRantus's picture

Upload folder using huggingface_hub

7134ce7 verified 2 months ago

history blame contribute delete

183 Bytes

	CUDA_VISIBLE_DEVICES=0 \
	swift export \
	--model Qwen/Qwen2.5-VL-3B-Instruct \
	--quant_method bnb \
	--quant_bits 4 \
	--output_dir Qwen2.5-VL-3B-Instruct-BNB-Int4