fastapi
uvicorn
huggingface_hub
pydantic
torch
peft
bitsandbytes
transformers
trl
accelerate