fastapi
uvicorn
torch
transformers
sentencepiece
accelerate
bitsandbytes