Add usage instructions

README.md

@@ -19,6 +19,13 @@ This repository hosts the TensorRT versions of **Stable Diffusion XL 1.0** creat
 
 ![examples](./examples.jpg)
 
+### Model Description
+
+- **Developed by:** Stability AI
+- **Model type:** Diffusion-based text-to-image generative model
+- **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md)
+- **Model Description:** This is a conversion of the [SDXL base 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) and [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0) models for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference
+
 
 ### Performance Comparison
 
@@ -39,9 +46,46 @@ This repository hosts the TensorRT versions of **Stable Diffusion XL 1.0** creat
 | H100        | 0.40 images/sec          | 0.68 images/sec             | ~70%                   |
 
 
-### Model Description
+### Usage Example
 
-- **Developed by:** Stability AI
-- **Model type:** Diffusion-based text-to-image generative model
-- **License:** [CreativeML Open RAIL++-M License](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0/blob/main/LICENSE.md)
-- **Model Description:** This is a conversion of the [SDXL base 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) and [SDXL refiner 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0) models for [NVIDIA TensorRT](https://developer.nvidia.com/tensorrt) optimized inference
+1. Following the [setup instructions](https://github.com/rajeevsrao/TensorRT/blob/release/8.6/demo/Diffusion/README.md) for TensorRT on launching a TensorRT NGC container.
+```shell
+git clone https://github.com/rajeevsrao/TensorRT.git
+cd TensorRT
+git checkout release/8.6
+docker run --rm -it --gpus all -v $PWD:/workspace nvcr.io/nvidia/pytorch:23.06-py3 /bin/bash
+```
+
+2. Download the SDXL TensorRT files from this repo
+```shell
+git lfs install 
+git clone https://huggingface.co/stabilityai/stable-diffusion-xl-1.0-tensorrt
+cd stable-diffusion-xl-1.0-tensorrt
+git lfs pull
+cd ..
+```
+
+3. Install libraries and requirements
+```shell
+python3 -m pip install --upgrade pip
+python3 -m pip install --upgrade tensorrt
+
+export TRT_OSSPATH=/workspace
+cd $TRT_OSSPATH/demo/Diffusion
+pip3 install -r requirements.txt
+```
+
+4. Perform TensorRT optimized inference
+```
+python3 demo_txt2img_xl.py \
+  "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" \
+  --hf-token=<Your HF TOKEN> \
+  --build-static-batch \
+  --use-cuda-graph \
+  --num-warmup-runs 1 \
+  --width 1024 \
+  --height 1024 \
+  --denoising-steps 30 \
+  --onnx-base-dir /workspace/stable-diffusion-xl-1.0-tensorrt/sdxl-1.0-base \
+  --onnx-refiner-dir /workspace/stable-diffusion-xl-1.0-tensorrt/sdxl-1.0-refiner
+```