Add instructions to quantize model

README.md

@@ -11,3 +11,11 @@ tags:
 
 Quantized weights of [coedit](https://github.com/vipulraheja/coedit) for inference with [candle](https://github.com/huggingface/candle/tree/main/candle-examples/examples/quantized-t5).
 
+Conversion command, using candle:
+
+```shell
+cargo run --example tensor-tools --release -- quantize \
+  --quantization q6k \
+  /path/to/coedit-<version>/model.safetensors \
+  --out-file model<version>.gguf
+```