Add SGLang serving instructions

#14
by MickJ - opened

Document SGLang Diffusion serve commands and OpenAI-compatible Cosmos3 visual generation endpoints.

NVIDIA org
β€’
edited Jun 10

Hey, we would like to merge your PR (SGLang model cards with code snippets + pointer to cookbook), but it needs few adjustments.

Could you please include the changes from PR !18? I.e.

  • SGLang as part of the Runtime Engine(s) section
  • SGLang as part of the Acceleration Engine section
  • Link to cookbook for advanced options

Also, could you rebase with main? (countDownloads section shouldn't get deleted)

kediwu0331 changed pull request status to merged

Sign up or log in to comment