Update README.md

README.md

@@ -25,7 +25,7 @@ This instruction model was built via parameter-efficient QLoRA finetuning of [ll
 
 We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as Hugging Face's [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
 
-### Helpful Links
+### Helpful links
 
 * Model license: Llama 2 Community License Agreement
 * Basic usage: [notebook](assets/basic_inference_llama_2_70b_dolphin.ipynb)
@@ -33,6 +33,12 @@ We use state-of-the-art [Language Model Evaluation Harness](https://github.com/E
 * Loss curves: [plot](https://huggingface.co/dfurman/llama-2-70b-dolphin-peft#finetuning-description)
 * Runtime stats: [table](https://huggingface.co/dfurman/llama-2-70b-dolphin-peft#runtime-tests)
 
+## Loss curve
+
+![loss curves](https://raw.githubusercontent.com/daniel-furman/sft-demos/main/assets/jul_24_23_1_14_00_log_loss_curves_llama-2-70b-dolphin.png)
+
+The above loss curve was generated from the run's private wandb.ai log.  
+
 ### Example prompts and responses
 
 Example 1: 
@@ -112,7 +118,7 @@ Example 3:
 
 <br>
 
-## Model Description
+## Model description
 
 The architecture is a modification of a standard decoder-only transformer.
 
@@ -129,22 +135,13 @@ The llama-2-70b models have been modified from a standard transformer in the fol
 | sequence length | 4096 |
 | grouped-query attention | ✔️ |
 
-
-## Finetuning Description
-
-This model was trained on a single H100 (80 GB PCIe) for about 17 hours using the [Lambda Labs](https://cloud.lambdalabs.com/instances) platform.
-
-![loss curves](https://raw.githubusercontent.com/daniel-furman/sft-demos/main/assets/jul_24_23_1_14_00_log_loss_curves_llama-2-70b-dolphin.png)
-
-The above loss curve was generated from the run's private wandb.ai log.  
-
-## PreTraining Data
+## PreTraining data
 
 For more details on the pretraining process, see [Llama-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf).
 
 The data was tokenized using the [Llama-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf) tokenizer.
 
-## Limitations and Biases
+## Limitations and biases
 
 _The following language is modified from [EleutherAI's GPT-NeoX-20B](https://huggingface.co/EleutherAI/gpt-neox-20b)_
 
@@ -152,7 +149,7 @@ This model can produce factually incorrect output, and should not be relied on t
 This model was trained on various public datasets.
 While great efforts have been taken to clean the pretraining data, it is possible that this model could generate lewd, biased or otherwise offensive outputs.
 
-## How to Use
+## How to use
 
 Basic usage: [notebook](assets/basic_inference_llama_2_70b_dolphin.ipynb)