Add a section explaining how to use the model

README.md

@@ -37,7 +37,38 @@ widget:
 
 Quantized weights of [CoEdIT](https://github.com/vipulraheja/coedit) for inference with [candle](https://github.com/huggingface/candle/tree/main/candle-examples/examples/quantized-t5).
 
-Conversion command, using candle:
+## Usage
+
+Clone [candle](https://github.com/huggingface/candle), and run the `quantized-t5` example:
+
+```shell
+$ cargo run --example quantized-t5 --release  -- \
+  --model-id "jbochi/candle-coedit-quantized" \
+  --prompt "Make this text coherent: Their flight is weak. They run quickly through the tree canopy." \
+  --temperature 0
+...
+ Although their flight is weak, they run quickly through the tree canopy.
+```
+
+By default, it will use CoEdIT-large (770M params, 643 MB).
+
+To use CoEdIT-xl (3B params, 2.34 GB), specify the weight-file and config-file:
+
+```shell
+$ cargo run --example quantized-t5 --release  -- \
+  --model-id "jbochi/candle-coedit-quantized" \
+  --weight-file "model-xl.gguf" \
+  --config-file "config-xl.json" \
+  --prompt "Rewrite to make this easier to understand: Note that a storm surge is what forecasters consider a hurricane's most treacherous aspect." \
+  --temperature 0
+...
+ Note that a storm surge is what forecasters consider a hurricane's most dangerous part.
+```
+
+
+## Model generation
+
+The weights were quantized using candle:
 
 ```shell
 cargo run --example tensor-tools --release -- quantize \