Spaces:

enCoder
/

tiny-vllm

Running

App Files Files Community

tiny-vllm / requirements.txt

enCoder's picture

minimal continuous-batching LLM engine

c32c359 11 days ago

history blame contribute delete

101 Bytes

	torch>=2.2
	transformers>=4.45
	fastapi>=0.110
	uvicorn[standard]>=0.27
	pydantic>=2.5
	numpy
	httpx>=0.27