configs / docker /README.md
Jakal-au's picture
Publish sanitized RTX PRO 4000 configs
af6a068 verified
|
Raw
History Blame Contribute Delete
422 Bytes

Docker

Docker examples should pin images by digest for reproducibility. Do not publish tokens, private model URLs, internal registry names, LAN IPs, hostnames, or SSH details.

The included launcher is a sanitized single-card vLLM pattern:

  • one Blackwell GPU exposed with --gpus device=0
  • OpenAI-compatible vLLM API on container port 8000
  • host bind to localhost for safety
  • placeholder model path
  • no secrets