Update README.md

README.md

@@ -17,3 +17,20 @@ We utilized the distributed training library [AxoNN](https://github.com/axonn-ai
 HPC-Coder-v2-6.7b is the best performing LLM under 30b parameters on the [ParEval](https://github.com/parallelcodefoundry/ParEval) parallel code generation benchmark in terms of _correctness_ and _performance_.
 It scores similarly to 34B and commercial models like Phind-V2 and GPT-4 on parallel code generation.
 
+## Using HPC-Coder-v2
+
+The model is provided as a standard huggingface model with safetensor weights.
+It can be used with [transformers pipelines](https://huggingface.co/docs/transformers/en/main_classes/pipelines), [vllm](https://github.com/vllm-project/vllm), or any other standard model inference framework.
+HPC-Coder-v2 is an instruct model and prompts need to be formatted as instructions for best results.
+It was trained with the following instruct template:
+
+```md
+Below is an instruction that describes a task. Write a response that appropriately completes the request.
+
+### Instruction:
+{instruction}
+
+### Response:
+
+```
+