Update vllm-omni deployment guide

#1
by Isotr0py - opened
Files changed (1) hide show
  1. README.md +26 -4
README.md CHANGED
@@ -13,6 +13,8 @@ tags:
13
  - image-generation
14
  - minimax-h3
15
  - diffusers
 
 
16
  ---
17
 
18
  <div align="center">
@@ -152,9 +154,29 @@ hf download MiniMaxAI/MiniMax-H3-Image-PE
152
  We recommend the following inference frameworks to serve the model:
153
 
154
  - [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-image)
155
- - [vLLM](https://github.com/vllm-project/vllm) - see [vllm recipes](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image)
156
- - [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs]()
157
- - [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](); use [T2I template]() / [Edit template]()
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
158
 
159
  #### SGLang Deployment
160
 
@@ -343,4 +365,4 @@ Text-to-image and image editing results, shown downscaled.
343
 
344
  ## Contact Us
345
 
346
- Contact us at [model@minimax.io](mailto:model@minimax.io).
 
13
  - image-generation
14
  - minimax-h3
15
  - diffusers
16
+ base_model:
17
+ - MiniMaxAI/MiniMax-H3
18
  ---
19
 
20
  <div align="center">
 
154
  We recommend the following inference frameworks to serve the model:
155
 
156
  - [SGLang](https://docs.sglang.io/) - see [cookbook](https://docs.sglang.io/cookbook/diffusion/MiniMax/MiniMax-H3-image)
157
+ - [vLLM-Omni](https://github.com/vllm-project/vllm-omni) - see [vllm-omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image)
158
+ - [diffusers](https://github.com/huggingface/diffusers) - see [diffusers docs](https://huggingface.co/docs/diffusers/main/en/api/pipelines/minimax_h3_image)
159
+ - [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - see [Comfy tutorial](https://docs.comfy.org/tutorials/image/minimax/minimax-h3-image); use [T2I template]() / [Edit template]()
160
+
161
+ #### vLLM-Omni Deployment
162
+
163
+ See the [vLLM-Omni recipe](https://recipes.vllm.ai/MiniMaxAI/MiniMax-H3-Image) for
164
+ per-hardware deployment configurations and measured latency. Both NVIDIA and AMD accelerators are
165
+ supported, including NVIDIA H200, RTX PRO 6000 Blackwell, AMD Instinct MI350X and more.
166
+
167
+ Start the server on one GPU:
168
+
169
+ ```bash
170
+ vllm serve MiniMaxAI/MiniMax-H3-Image --omni --host 0.0.0.0 --port 8000
171
+ ```
172
+
173
+ For lower latency, split each request over several GPUs with sequence parallelism
174
+ (Ulysses), for example on 4 GPUs:
175
+
176
+ ```bash
177
+ vllm serve MiniMaxAI/MiniMax-H3-Image --omni --host 0.0.0.0 --port 8000 \
178
+ --num-gpus 4 --usp 4 --text-encoder-tp-size 4
179
+ ```
180
 
181
  #### SGLang Deployment
182
 
 
365
 
366
  ## Contact Us
367
 
368
+ Contact us at [model@minimax.io](mailto:model@minimax.io).