Spaces:

tinkersnot
/

bench-server

Paused

App Files Files Community

bench-server / README.md

tinkersnot

Upload folder using huggingface_hub

a7d82b8 verified about 2 months ago

preview code

Raw

History Blame Contribute Delete

276 Bytes

metadata

title: Tinkersnot Bench Server
emoji: 🦙
colorFrom: blue
colorTo: green
sdk: docker
app_port: 7860
pinned: false

OpenAI-compatible llama.cpp server for base-model bake-off eval. Endpoint: /v1/chat/completions. Model set via LLAMA_ARG_HF_REPO in the Dockerfile.