Spaces:
Running on A10G
Running on A10G
Suggestion to set max queue size
#6
by
abidlabs HF Staff - opened
In order to reduce long wait times, you could consider adding a max queue size. After the queue size reaches this amount, no further users are added to the queue, and instead an error message is displayed. We've found that this tends to provide a better UI for users as it rewards those users who are persistent (i.e. those who try to run the prediction again) and gives them a shorter wait time
abidlabs changed pull request title from
Update app.py
to Suggestion to set max queue size
Good idea!
pharmapsychotic changed pull request status to
merged