Spaces:

Elfsong
/

Arena

Build error

12.1 kB

Ctrl+K

3 contributors

feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes.

04ffcc8 4 months ago

.gitattributes

1.52 kB
Duplicate from gradio-templates/chatbot 6 months ago
.gitignore

31 Bytes
feat: Expand GPU mapping for model launching and enhance logging output with emojis for better visibility. 5 months ago
README.md

437 Bytes
initial commit 6 months ago
app.py

5.76 kB
refactor: Simplify model configuration by replacing dynamic GPU mapping with a static dictionary, and enhance bot response function to include a seed value for reproducibility in responses. 4 months ago
launch_models.py

2.46 kB
feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes. 4 months ago
model_launch.sh

1.83 kB
feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes. 4 months ago
requirements.txt

77 Bytes
chore: Update GPU mapping for model launches by commenting out unused configurations and adjust GPU memory utilization to 0.3. Add additional dependencies to requirements.txt for enhanced functionality. 5 months ago