Spaces:
Sleeping
Sleeping
metadata
title: NeuroHealth GGUF Space
emoji: 🤖
colorFrom: gray
colorTo: green
sdk: docker
sdk_version: '1.0'
python_version: '3.11'
app_file: app.py
pinned: false
NeuroHealth GGUF Space
This space exposes the qwen2-1_5b-instruct-q4_0.gguf model in backend/saved_models for text generation.
Endpoints
GET /health— GGUF file availabilityPOST /generate— text generation
Request body example
{
"prompt": "Explain the role of dopamine in Parkinson's disease.",
"max_tokens": 256,
"temperature": 0.8,
"top_p": 0.95
}
Run locally with Docker
docker build -t neurohealth-gguf .
docker run --rm -p 7860:7860 neurohealth-gguf