Aether-Sovereign-AI / requirements.txt
SeaWolf-AI's picture
serving: manual load + GenerationMixin + use_cache=False + streaming
bc713ee verified
Raw
History Blame Contribute Delete
140 Bytes
fastapi==0.115.6
uvicorn[standard]==0.34.0
torch
transformers==5.3.0
huggingface_hub>=0.25
hf_transfer
safetensors
accelerate
sentencepiece