fastapi
uvicorn
torch
transformers
peft
accelerate
bitsandbytes>=0.46.1
pydantic