Udith-Sandaruwan commited on
Commit
605bc91
·
verified ·
1 Parent(s): 8d694cd

Model save

Browse files
Files changed (1) hide show
  1. README.md +3 -6
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [meta-llama/Meta-Llama-3.1-8B](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.7161
20
 
21
  ## Model description
22
 
@@ -43,17 +43,14 @@ The following hyperparameters were used during training:
43
  - total_train_batch_size: 24
44
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
45
  - lr_scheduler_type: cosine
46
- - training_steps: 40
47
  - mixed_precision_training: Native AMP
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:------:|:----:|:---------------:|
53
- | 3.2668 | 0.0003 | 10 | 2.8281 |
54
- | 2.0234 | 0.0006 | 20 | 2.0007 |
55
- | 2.3921 | 0.0010 | 30 | 1.8118 |
56
- | 1.8744 | 0.0013 | 40 | 1.7161 |
57
 
58
 
59
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [meta-llama/Meta-Llama-3.1-8B](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.5411
20
 
21
  ## Model description
22
 
 
43
  - total_train_batch_size: 24
44
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
45
  - lr_scheduler_type: cosine
46
+ - training_steps: 10
47
  - mixed_precision_training: Native AMP
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss |
52
  |:-------------:|:------:|:----:|:---------------:|
53
+ | 3.1171 | 0.0003 | 10 | 2.5411 |
 
 
 
54
 
55
 
56
  ### Framework versions