fastapi
uvicorn
git+https://github.com/huggingface/transformers.git
torch>=2.0.0
accelerate>=0.25.0
pydantic
sentencepiece