End of training

README.md

@@ -1,6 +1,7 @@
 ---
 library_name: peft
 tags:
+- axolotl
 - generated_from_trainer
 base_model: NousResearch/Llama-2-7b-hf
 model-index:
@@ -96,7 +97,9 @@ special_tokens:
 
 # neocortex-grounded
 
-This model is a fine-tuned version of [NousResearch/Llama-2-7b-hf](https://huggingface.co/NousResearch/Llama-2-7b-hf) on an unknown dataset.
+This model is a fine-tuned version of [NousResearch/Llama-2-7b-hf](https://huggingface.co/NousResearch/Llama-2-7b-hf) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.1270
 
 ## Model description
 
@@ -129,6 +132,23 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_steps: 10
 - num_epochs: 3
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 1.7091        | 0.01  | 1    | 1.7034          |
+| 1.3312        | 0.29  | 20   | 1.2385          |
+| 1.1599        | 0.58  | 40   | 1.1702          |
+| 1.1673        | 0.87  | 60   | 1.1425          |
+| 1.0802        | 1.16  | 80   | 1.1291          |
+| 1.0736        | 1.45  | 100  | 1.1238          |
+| 1.0308        | 1.74  | 120  | 1.1185          |
+| 1.0042        | 2.03  | 140  | 1.1110          |
+| 0.997         | 2.32  | 160  | 1.1274          |
+| 0.8535        | 2.61  | 180  | 1.1278          |
+| 0.9331        | 2.9   | 200  | 1.1270          |
+
+
 ### Framework versions
 
 - PEFT 0.9.0

adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d7b096c0cb82bbe8c4710b8b3f4b5ca6072fc0f193e9549aa9302be9f024f033
+size 319977229