Update README.md

README.md

@@ -11,8 +11,15 @@ tags:
 - deepsparse
 ---
 # MiniChat-3B - DeepSparse
-## Usage
+This repo contains model files for [MiniChat-3B ](https://huggingface.co/GeneZC/MiniChat-3B) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
 
+This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
+## Inference
+Install [DeepSparse LLM](https://github.com/neuralmagic/deepsparse) for fast inference on CPUs: 
+```bash
+pip install deepsparse-nightly[llm]
+```
+Run in a [Python pipeline](https://github.com/neuralmagic/deepsparse/blob/main/docs/llms/text-generation-pipeline.md):
 ```python
 from deepsparse import TextGeneration
 
@@ -47,7 +54,15 @@ To become a great software engineer, you need to have a strong foundation in com
 By following these tips, you can become a great software engineer and develop software applications that can benefit society.
 """
 ```
-## One-shot and Export
+## Prompt template
+```
+
+  <s> [|User|]\n
+  {prompt}
+  </s>[|Assistant|]\n
+```
+## Sparsification
+For details on how this model was sparsified, see the `recipe.yaml` in this repo and follow the instructions below.
 
 ```bash
 git clone https://github.com/neuralmagic/sparseml