Document Docker image used for TensorRT-LLM example
Browse files
README.md
CHANGED
|
@@ -111,6 +111,8 @@ This model was obtained by quantizing the weights and activations of Wan2.2-T2V-
|
|
| 111 |
|
| 112 |
To serve this checkpoint with [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/visual_gen/serve/README.md):
|
| 113 |
|
|
|
|
|
|
|
| 114 |
```sh
|
| 115 |
# TRTLLM
|
| 116 |
trtllm-serve nvidia/Wan2.2-T2V-A14B-Diffusers-FP8 --visual_gen_args ./examples/visual_gen/serve/configs/wan22.yml
|
|
|
|
| 111 |
|
| 112 |
To serve this checkpoint with [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/visual_gen/serve/README.md):
|
| 113 |
|
| 114 |
+
Docker image used for the TensorRT-LLM example: `nvcr.io/nvidia/tensorrt-llm/release:1.4.0rc0`.
|
| 115 |
+
|
| 116 |
```sh
|
| 117 |
# TRTLLM
|
| 118 |
trtllm-serve nvidia/Wan2.2-T2V-A14B-Diffusers-FP8 --visual_gen_args ./examples/visual_gen/serve/configs/wan22.yml
|