yiguo-nv commited on
Commit
5f0dc36
·
verified ·
1 Parent(s): ed5341f

Document Docker image used for TensorRT-LLM example

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -111,6 +111,8 @@ This model was obtained by quantizing the weights and activations of Wan2.2-T2V-
111
 
112
  To serve this checkpoint with [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/visual_gen/serve/README.md):
113
 
 
 
114
  ```sh
115
  # TRTLLM
116
  trtllm-serve nvidia/Wan2.2-T2V-A14B-Diffusers-FP8 --visual_gen_args ./examples/visual_gen/serve/configs/wan22.yml
 
111
 
112
  To serve this checkpoint with [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/visual_gen/serve/README.md):
113
 
114
+ Docker image used for the TensorRT-LLM example: `nvcr.io/nvidia/tensorrt-llm/release:1.4.0rc0`.
115
+
116
  ```sh
117
  # TRTLLM
118
  trtllm-serve nvidia/Wan2.2-T2V-A14B-Diffusers-FP8 --visual_gen_args ./examples/visual_gen/serve/configs/wan22.yml