torch
transformers
peft
accelerate
bitsandbytes
fastapi
uvicorn
bitsandbytes