fastapi
uvicorn
transformers
torch
bitsandbytes
accelerate>=0.26.0