Audio length limit?
#15
by weightsnweights - opened
Is there a audio length limit? I get only 18s (when running on the HF space)
You will have to increase the max_tokens in advanced settings.
Tried maxing the max_tokens but still get only 20s. And it picks a random set of sentences in the middle of the text that I input.
That is a limitation for transformers based inference. That is the max context for that model. We have however created this repository using fastAPI and sliding window approach for more longer and stable generations using vLLM as inference engine. https://github.com/MayaResearch/maya1-fastapi