fastapi
uvicorn
torch
sentence-transformers
redis
accelerate 
peft 
huggingface_hub