transformers
torch
huggingface_hub
uvicorn
fastapi
accelerate
bitsandbytes