Update README.md

README.md

@@ -2,9 +2,10 @@
 license: llama2
 ---
 
-Lora finetuning on Wikipedia-10, applying increased dropout for all layers
-Dataset: Wikipedia-10
-Target modules = ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj"]
+# Lora finetuning on Wikipedia-10, applying increased dropout for all layers
+- Dataset: Wikipedia-10
+- Target modules = ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj", "down_proj"]
+```
 {
     "epoch": 0.1857053320643469,
     "total_flos": 2.605973017460736e+18,
@@ -14,5 +15,6 @@ Target modules = ["q_proj", "k_proj", "v_proj", "o_proj", "gate_proj", "up_proj"
     "train_samples_per_second": 0.473,
     "train_steps_per_second": 0.015
 }
+```
 
-Training script: https://github.com/ao9000/bias-bench/blob/main/experiments/run_clm.py
+# Training script: https://github.com/ao9000/bias-bench/blob/main/experiments/run_clm.py