monsterapi
/

OpenPlatypus_LLAMA2_7b

meta-llama/Llama-2-7b-hf

logical-reasoning

Model card Files Files and versions

Zangs3011 commited on Sep 6, 2023

Commit

11bec35

·

1 Parent(s): 3f99e02

Update README.md

Files changed (1) hide show

README.md +1 -3

README.md CHANGED Viewed

@@ -21,13 +21,11 @@ The finetuning session got completed in 1 hour and 30 minutes and costed us only
 #### Hyperparameters & Run details:
 - Model Path: meta-llama/Llama-2-7b-hf
 - Dataset: garage-bAInd/Open-Platypus
-- Learning rate: 0.0003
 - Number of epochs: 5
 - Data split: Training: 90% / Validation: 10%
 - Gradient accumulation steps: 1
-Loss metrics:
-![training loss](train-loss.png "Training loss")
 ---
 license: apache-2.0

 #### Hyperparameters & Run details:
 - Model Path: meta-llama/Llama-2-7b-hf
 - Dataset: garage-bAInd/Open-Platypus
+- Learning rate: 0.0002
 - Number of epochs: 5
 - Data split: Training: 90% / Validation: 10%
 - Gradient accumulation steps: 1
 ---
 license: apache-2.0