Add ChatML prompt format details

README.md

@@ -30,6 +30,30 @@ And then a DPO finetune using:
 - [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
 - [argilla/ultrafeedback-binarized-preferences-cleaned](https://huggingface.co/datasets/argilla/ultrafeedback-binarized-preferences-cleaned)
 
+# Prompt Format
+
+Phi-2 Orange uses ChatML as the prompt format, with or without the system instruction.
+
+To prompt with a system instruction (use whatever system prompt you like):
+
+```
+<|im_start|>system
+You are a helpful assistant for Python which outputs in Markdown format.<|im_end|>
+<|im_start|>user
+Write a function to calculate the Fibonacci sequence<|im_end|>
+<|im_start|>assistant
+
+```
+
+You can also omit the system prompt if you wish:
+
+```
+<|im_start|>user
+Why is the sky blue?<|im_end|>
+<|im_start|>assistant
+
+```
+
 # Evaluations
 Evaluations done using mlabonne's usefull [Colab notebook llm-autoeval](https://github.com/mlabonne/llm-autoeval).
 Also check out the alternative leaderboard at [Yet_Another_LLM_Leaderboard](https://huggingface.co/spaces/mlabonne/Yet_Another_LLM_Leaderboard)