vllm real-time support

#231
by jxadro - opened

Hi.

Is it planned to enable whisper for vllm real time?

https://docs.vllm.ai/en/latest/models/supported_models/#realtime-transcription

Currently for speech to text it is supported:

-mistralai/Voxtral-Mini-4B-Realtime-2602
-Qwen/Qwen3-ASR-0.6B

Thank you.

Sign up or log in to comment