torch
transformers
peft
modelscope
gradio
vllm