Student0809
/

bbb

Model card Files Files and versions

bbb / ms-swift /examples /infer /cli_demo.sh

Student0809's picture

Add files using upload-large-folder tool

511365c verified 9 months ago

history blame contribute delete

151 Bytes

	CUDA_VISIBLE_DEVICES=0 \
	swift infer \
	--model Qwen/Qwen2.5-1.5B-Instruct \
	--infer_backend pt \
	--stream true \
	--max_new_tokens 2048