Darwin-36B-Opus-VKAE / run_docker.sh
SeaWolf-AI's picture
Add Docker run files (Dockerfile, compose, run script)
efda0eb verified
Raw
History Blame Contribute Delete
665 Bytes
#!/usr/bin/env bash
# Darwin-36B-Opus — VKAE Accelerated : one-command launch.
# Requires an NVIDIA GPU (Blackwell B200 / Hopper H100/H200, ~80GB) + nvidia-container-toolkit.
set -euo pipefail
IMAGE="vidraft/darwin36-vkae:281"
docker pull "$IMAGE"
docker run --rm --gpus all -p 8000:8000 --ipc=host "$IMAGE"
# The container serves an OpenAI-compatible API on http://localhost:8000/v1
#
# Discover the served model name:
# curl http://localhost:8000/v1/models
#
# Chat completion:
# curl http://localhost:8000/v1/chat/completions # -H "Content-Type: application/json" # -d '{"model":"darwin36-vkae","messages":[{"role":"user","content":"Hello!"}]}'