BechusRantus
/

injected_thinking

Model card Files Files and versions

injected_thinking / third_party /ms-swift /examples /export /quantize /fp8.sh

BechusRantus's picture

Upload folder using huggingface_hub

7134ce7 verified 2 months ago

history blame contribute delete

150 Bytes

	CUDA_VISIBLE_DEVICES=0 \
	swift export \
	--model Qwen/Qwen2.5-3B-Instruct \
	--quant_method fp8 \
	--output_dir Qwen2.5-3B-Instruct-FP8