anderloh commited on
Commit
8efcb0e
·
verified ·
1 Parent(s): 1d67145

End of training

Browse files
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  base_model: anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test
3
  tags:
 
4
  - generated_from_trainer
5
  metrics:
6
  - accuracy
@@ -14,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # TestV3
16
 
17
- This model is a fine-tuned version of [anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test](https://huggingface.co/anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.9442
20
- - Accuracy: 0.6678
21
 
22
  ## Model description
23
 
 
1
  ---
2
  base_model: anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test
3
  tags:
4
+ - audio-classification
5
  - generated_from_trainer
6
  metrics:
7
  - accuracy
 
15
 
16
  # TestV3
17
 
18
+ This model is a fine-tuned version of [anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test](https://huggingface.co/anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test) on the anderloh/Master5Class dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.9449
21
+ - Accuracy: 0.6713
22
 
23
  ## Model description
24
 
all_results.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 323.08,
3
+ "eval_accuracy": 0.6713286713286714,
4
+ "eval_loss": 0.9449206590652466,
5
+ "eval_runtime": 5.6003,
6
+ "eval_samples_per_second": 51.068,
7
+ "eval_steps_per_second": 0.536,
8
+ "train_loss": 0.8572167641775948,
9
+ "train_runtime": 4856.1657,
10
+ "train_samples_per_second": 111.57,
11
+ "train_steps_per_second": 0.216
12
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 323.08,
3
+ "eval_accuracy": 0.6713286713286714,
4
+ "eval_loss": 0.9449206590652466,
5
+ "eval_runtime": 5.6003,
6
+ "eval_samples_per_second": 51.068,
7
+ "eval_steps_per_second": 0.536
8
+ }
runs/Jun19_22-02-00_ml6.hpc.uio.no/events.out.tfevents.1718832205.ml6.hpc.uio.no.3866375.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43c1872d23865c2adc30d140c39d65db955c3a7affdccb951544545e87e48b98
3
+ size 411
train_results.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 323.08,
3
+ "train_loss": 0.8572167641775948,
4
+ "train_runtime": 4856.1657,
5
+ "train_samples_per_second": 111.57,
6
+ "train_steps_per_second": 0.216
7
+ }
trainer_state.json ADDED
@@ -0,0 +1,3093 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.6713286713286714,
3
+ "best_model_checkpoint": "wav2vec2-5Class-train-test-finetune-V1/checkpoint-858",
4
+ "epoch": 323.0769230769231,
5
+ "eval_steps": 500,
6
+ "global_step": 1050,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.92,
13
+ "eval_accuracy": 0.16083916083916083,
14
+ "eval_loss": 1.6025770902633667,
15
+ "eval_runtime": 4.6997,
16
+ "eval_samples_per_second": 60.854,
17
+ "eval_steps_per_second": 0.638,
18
+ "step": 3
19
+ },
20
+ {
21
+ "epoch": 1.85,
22
+ "eval_accuracy": 0.16083916083916083,
23
+ "eval_loss": 1.6024432182312012,
24
+ "eval_runtime": 4.9888,
25
+ "eval_samples_per_second": 57.329,
26
+ "eval_steps_per_second": 0.601,
27
+ "step": 6
28
+ },
29
+ {
30
+ "epoch": 2.77,
31
+ "eval_accuracy": 0.16083916083916083,
32
+ "eval_loss": 1.6022151708602905,
33
+ "eval_runtime": 4.302,
34
+ "eval_samples_per_second": 66.481,
35
+ "eval_steps_per_second": 0.697,
36
+ "step": 9
37
+ },
38
+ {
39
+ "epoch": 4.0,
40
+ "eval_accuracy": 0.16083916083916083,
41
+ "eval_loss": 1.6017613410949707,
42
+ "eval_runtime": 4.5772,
43
+ "eval_samples_per_second": 62.484,
44
+ "eval_steps_per_second": 0.655,
45
+ "step": 13
46
+ },
47
+ {
48
+ "epoch": 4.92,
49
+ "eval_accuracy": 0.16083916083916083,
50
+ "eval_loss": 1.6013050079345703,
51
+ "eval_runtime": 4.3565,
52
+ "eval_samples_per_second": 65.649,
53
+ "eval_steps_per_second": 0.689,
54
+ "step": 16
55
+ },
56
+ {
57
+ "epoch": 5.85,
58
+ "eval_accuracy": 0.16083916083916083,
59
+ "eval_loss": 1.6007716655731201,
60
+ "eval_runtime": 4.1903,
61
+ "eval_samples_per_second": 68.253,
62
+ "eval_steps_per_second": 0.716,
63
+ "step": 19
64
+ },
65
+ {
66
+ "epoch": 6.77,
67
+ "eval_accuracy": 0.16083916083916083,
68
+ "eval_loss": 1.6001368761062622,
69
+ "eval_runtime": 4.7263,
70
+ "eval_samples_per_second": 60.513,
71
+ "eval_steps_per_second": 0.635,
72
+ "step": 22
73
+ },
74
+ {
75
+ "epoch": 8.0,
76
+ "eval_accuracy": 0.16083916083916083,
77
+ "eval_loss": 1.599120020866394,
78
+ "eval_runtime": 4.511,
79
+ "eval_samples_per_second": 63.4,
80
+ "eval_steps_per_second": 0.665,
81
+ "step": 26
82
+ },
83
+ {
84
+ "epoch": 8.92,
85
+ "eval_accuracy": 0.16433566433566432,
86
+ "eval_loss": 1.5982468128204346,
87
+ "eval_runtime": 4.2484,
88
+ "eval_samples_per_second": 67.319,
89
+ "eval_steps_per_second": 0.706,
90
+ "step": 29
91
+ },
92
+ {
93
+ "epoch": 9.85,
94
+ "eval_accuracy": 0.1853146853146853,
95
+ "eval_loss": 1.597304105758667,
96
+ "eval_runtime": 3.8273,
97
+ "eval_samples_per_second": 74.726,
98
+ "eval_steps_per_second": 0.784,
99
+ "step": 32
100
+ },
101
+ {
102
+ "epoch": 10.77,
103
+ "eval_accuracy": 0.1888111888111888,
104
+ "eval_loss": 1.5962693691253662,
105
+ "eval_runtime": 4.8122,
106
+ "eval_samples_per_second": 59.432,
107
+ "eval_steps_per_second": 0.623,
108
+ "step": 35
109
+ },
110
+ {
111
+ "epoch": 12.0,
112
+ "eval_accuracy": 0.21678321678321677,
113
+ "eval_loss": 1.5947297811508179,
114
+ "eval_runtime": 4.7135,
115
+ "eval_samples_per_second": 60.677,
116
+ "eval_steps_per_second": 0.636,
117
+ "step": 39
118
+ },
119
+ {
120
+ "epoch": 12.92,
121
+ "eval_accuracy": 0.23076923076923078,
122
+ "eval_loss": 1.59347403049469,
123
+ "eval_runtime": 4.362,
124
+ "eval_samples_per_second": 65.567,
125
+ "eval_steps_per_second": 0.688,
126
+ "step": 42
127
+ },
128
+ {
129
+ "epoch": 13.85,
130
+ "eval_accuracy": 0.23076923076923078,
131
+ "eval_loss": 1.592130184173584,
132
+ "eval_runtime": 3.6426,
133
+ "eval_samples_per_second": 78.514,
134
+ "eval_steps_per_second": 0.824,
135
+ "step": 45
136
+ },
137
+ {
138
+ "epoch": 14.77,
139
+ "eval_accuracy": 0.24825174825174826,
140
+ "eval_loss": 1.5907161235809326,
141
+ "eval_runtime": 3.8908,
142
+ "eval_samples_per_second": 73.506,
143
+ "eval_steps_per_second": 0.771,
144
+ "step": 48
145
+ },
146
+ {
147
+ "epoch": 15.38,
148
+ "grad_norm": 0.9358195066452026,
149
+ "learning_rate": 1.4285714285714285e-05,
150
+ "loss": 1.5896,
151
+ "step": 50
152
+ },
153
+ {
154
+ "epoch": 16.0,
155
+ "eval_accuracy": 0.27972027972027974,
156
+ "eval_loss": 1.588749647140503,
157
+ "eval_runtime": 4.5869,
158
+ "eval_samples_per_second": 62.352,
159
+ "eval_steps_per_second": 0.654,
160
+ "step": 52
161
+ },
162
+ {
163
+ "epoch": 16.92,
164
+ "eval_accuracy": 0.2937062937062937,
165
+ "eval_loss": 1.5871775150299072,
166
+ "eval_runtime": 3.7115,
167
+ "eval_samples_per_second": 77.057,
168
+ "eval_steps_per_second": 0.808,
169
+ "step": 55
170
+ },
171
+ {
172
+ "epoch": 17.85,
173
+ "eval_accuracy": 0.3041958041958042,
174
+ "eval_loss": 1.5855580568313599,
175
+ "eval_runtime": 4.1287,
176
+ "eval_samples_per_second": 69.271,
177
+ "eval_steps_per_second": 0.727,
178
+ "step": 58
179
+ },
180
+ {
181
+ "epoch": 18.77,
182
+ "eval_accuracy": 0.3356643356643357,
183
+ "eval_loss": 1.5838947296142578,
184
+ "eval_runtime": 4.2428,
185
+ "eval_samples_per_second": 67.408,
186
+ "eval_steps_per_second": 0.707,
187
+ "step": 61
188
+ },
189
+ {
190
+ "epoch": 20.0,
191
+ "eval_accuracy": 0.3706293706293706,
192
+ "eval_loss": 1.5815041065216064,
193
+ "eval_runtime": 4.1047,
194
+ "eval_samples_per_second": 69.677,
195
+ "eval_steps_per_second": 0.731,
196
+ "step": 65
197
+ },
198
+ {
199
+ "epoch": 20.92,
200
+ "eval_accuracy": 0.3811188811188811,
201
+ "eval_loss": 1.5795336961746216,
202
+ "eval_runtime": 4.3419,
203
+ "eval_samples_per_second": 65.869,
204
+ "eval_steps_per_second": 0.691,
205
+ "step": 68
206
+ },
207
+ {
208
+ "epoch": 21.85,
209
+ "eval_accuracy": 0.3776223776223776,
210
+ "eval_loss": 1.5774352550506592,
211
+ "eval_runtime": 5.0868,
212
+ "eval_samples_per_second": 56.224,
213
+ "eval_steps_per_second": 0.59,
214
+ "step": 71
215
+ },
216
+ {
217
+ "epoch": 22.77,
218
+ "eval_accuracy": 0.36013986013986016,
219
+ "eval_loss": 1.5753329992294312,
220
+ "eval_runtime": 4.2391,
221
+ "eval_samples_per_second": 67.468,
222
+ "eval_steps_per_second": 0.708,
223
+ "step": 74
224
+ },
225
+ {
226
+ "epoch": 24.0,
227
+ "eval_accuracy": 0.3531468531468531,
228
+ "eval_loss": 1.5723278522491455,
229
+ "eval_runtime": 4.1913,
230
+ "eval_samples_per_second": 68.237,
231
+ "eval_steps_per_second": 0.716,
232
+ "step": 78
233
+ },
234
+ {
235
+ "epoch": 24.92,
236
+ "eval_accuracy": 0.33916083916083917,
237
+ "eval_loss": 1.5699166059494019,
238
+ "eval_runtime": 4.1956,
239
+ "eval_samples_per_second": 68.166,
240
+ "eval_steps_per_second": 0.715,
241
+ "step": 81
242
+ },
243
+ {
244
+ "epoch": 25.85,
245
+ "eval_accuracy": 0.32867132867132864,
246
+ "eval_loss": 1.5674887895584106,
247
+ "eval_runtime": 4.2222,
248
+ "eval_samples_per_second": 67.737,
249
+ "eval_steps_per_second": 0.711,
250
+ "step": 84
251
+ },
252
+ {
253
+ "epoch": 26.77,
254
+ "eval_accuracy": 0.32167832167832167,
255
+ "eval_loss": 1.564941167831421,
256
+ "eval_runtime": 4.3597,
257
+ "eval_samples_per_second": 65.6,
258
+ "eval_steps_per_second": 0.688,
259
+ "step": 87
260
+ },
261
+ {
262
+ "epoch": 28.0,
263
+ "eval_accuracy": 0.3146853146853147,
264
+ "eval_loss": 1.5612314939498901,
265
+ "eval_runtime": 4.4489,
266
+ "eval_samples_per_second": 64.285,
267
+ "eval_steps_per_second": 0.674,
268
+ "step": 91
269
+ },
270
+ {
271
+ "epoch": 28.92,
272
+ "eval_accuracy": 0.3111888111888112,
273
+ "eval_loss": 1.5583022832870483,
274
+ "eval_runtime": 3.9002,
275
+ "eval_samples_per_second": 73.33,
276
+ "eval_steps_per_second": 0.769,
277
+ "step": 94
278
+ },
279
+ {
280
+ "epoch": 29.85,
281
+ "eval_accuracy": 0.3076923076923077,
282
+ "eval_loss": 1.5552746057510376,
283
+ "eval_runtime": 3.8211,
284
+ "eval_samples_per_second": 74.848,
285
+ "eval_steps_per_second": 0.785,
286
+ "step": 97
287
+ },
288
+ {
289
+ "epoch": 30.77,
290
+ "grad_norm": 1.0354599952697754,
291
+ "learning_rate": 2.857142857142857e-05,
292
+ "loss": 1.5478,
293
+ "step": 100
294
+ },
295
+ {
296
+ "epoch": 30.77,
297
+ "eval_accuracy": 0.3111888111888112,
298
+ "eval_loss": 1.5521942377090454,
299
+ "eval_runtime": 3.9174,
300
+ "eval_samples_per_second": 73.008,
301
+ "eval_steps_per_second": 0.766,
302
+ "step": 100
303
+ },
304
+ {
305
+ "epoch": 32.0,
306
+ "eval_accuracy": 0.3006993006993007,
307
+ "eval_loss": 1.5478450059890747,
308
+ "eval_runtime": 4.2795,
309
+ "eval_samples_per_second": 66.83,
310
+ "eval_steps_per_second": 0.701,
311
+ "step": 104
312
+ },
313
+ {
314
+ "epoch": 32.92,
315
+ "eval_accuracy": 0.2937062937062937,
316
+ "eval_loss": 1.5445122718811035,
317
+ "eval_runtime": 4.2852,
318
+ "eval_samples_per_second": 66.742,
319
+ "eval_steps_per_second": 0.7,
320
+ "step": 107
321
+ },
322
+ {
323
+ "epoch": 33.85,
324
+ "eval_accuracy": 0.2867132867132867,
325
+ "eval_loss": 1.5413419008255005,
326
+ "eval_runtime": 4.7279,
327
+ "eval_samples_per_second": 60.492,
328
+ "eval_steps_per_second": 0.635,
329
+ "step": 110
330
+ },
331
+ {
332
+ "epoch": 34.77,
333
+ "eval_accuracy": 0.2762237762237762,
334
+ "eval_loss": 1.5382936000823975,
335
+ "eval_runtime": 4.5512,
336
+ "eval_samples_per_second": 62.841,
337
+ "eval_steps_per_second": 0.659,
338
+ "step": 113
339
+ },
340
+ {
341
+ "epoch": 36.0,
342
+ "eval_accuracy": 0.2762237762237762,
343
+ "eval_loss": 1.5340471267700195,
344
+ "eval_runtime": 4.0909,
345
+ "eval_samples_per_second": 69.911,
346
+ "eval_steps_per_second": 0.733,
347
+ "step": 117
348
+ },
349
+ {
350
+ "epoch": 36.92,
351
+ "eval_accuracy": 0.26573426573426573,
352
+ "eval_loss": 1.5310546159744263,
353
+ "eval_runtime": 3.6024,
354
+ "eval_samples_per_second": 79.392,
355
+ "eval_steps_per_second": 0.833,
356
+ "step": 120
357
+ },
358
+ {
359
+ "epoch": 37.85,
360
+ "eval_accuracy": 0.2517482517482518,
361
+ "eval_loss": 1.5282360315322876,
362
+ "eval_runtime": 3.8247,
363
+ "eval_samples_per_second": 74.777,
364
+ "eval_steps_per_second": 0.784,
365
+ "step": 123
366
+ },
367
+ {
368
+ "epoch": 38.77,
369
+ "eval_accuracy": 0.24475524475524477,
370
+ "eval_loss": 1.5255342721939087,
371
+ "eval_runtime": 4.5969,
372
+ "eval_samples_per_second": 62.216,
373
+ "eval_steps_per_second": 0.653,
374
+ "step": 126
375
+ },
376
+ {
377
+ "epoch": 40.0,
378
+ "eval_accuracy": 0.24125874125874125,
379
+ "eval_loss": 1.5223983526229858,
380
+ "eval_runtime": 4.5515,
381
+ "eval_samples_per_second": 62.836,
382
+ "eval_steps_per_second": 0.659,
383
+ "step": 130
384
+ },
385
+ {
386
+ "epoch": 40.92,
387
+ "eval_accuracy": 0.23426573426573427,
388
+ "eval_loss": 1.5204370021820068,
389
+ "eval_runtime": 3.5155,
390
+ "eval_samples_per_second": 81.354,
391
+ "eval_steps_per_second": 0.853,
392
+ "step": 133
393
+ },
394
+ {
395
+ "epoch": 41.85,
396
+ "eval_accuracy": 0.24475524475524477,
397
+ "eval_loss": 1.5190935134887695,
398
+ "eval_runtime": 4.1808,
399
+ "eval_samples_per_second": 68.409,
400
+ "eval_steps_per_second": 0.718,
401
+ "step": 136
402
+ },
403
+ {
404
+ "epoch": 42.77,
405
+ "eval_accuracy": 0.23776223776223776,
406
+ "eval_loss": 1.5183987617492676,
407
+ "eval_runtime": 5.6726,
408
+ "eval_samples_per_second": 50.418,
409
+ "eval_steps_per_second": 0.529,
410
+ "step": 139
411
+ },
412
+ {
413
+ "epoch": 44.0,
414
+ "eval_accuracy": 0.23076923076923078,
415
+ "eval_loss": 1.518118143081665,
416
+ "eval_runtime": 4.9675,
417
+ "eval_samples_per_second": 57.575,
418
+ "eval_steps_per_second": 0.604,
419
+ "step": 143
420
+ },
421
+ {
422
+ "epoch": 44.92,
423
+ "eval_accuracy": 0.23076923076923078,
424
+ "eval_loss": 1.5188548564910889,
425
+ "eval_runtime": 3.8693,
426
+ "eval_samples_per_second": 73.915,
427
+ "eval_steps_per_second": 0.775,
428
+ "step": 146
429
+ },
430
+ {
431
+ "epoch": 45.85,
432
+ "eval_accuracy": 0.23776223776223776,
433
+ "eval_loss": 1.5198808908462524,
434
+ "eval_runtime": 4.5179,
435
+ "eval_samples_per_second": 63.304,
436
+ "eval_steps_per_second": 0.664,
437
+ "step": 149
438
+ },
439
+ {
440
+ "epoch": 46.15,
441
+ "grad_norm": 0.8092480897903442,
442
+ "learning_rate": 2.857142857142857e-05,
443
+ "loss": 1.4365,
444
+ "step": 150
445
+ },
446
+ {
447
+ "epoch": 46.77,
448
+ "eval_accuracy": 0.24825174825174826,
449
+ "eval_loss": 1.5214567184448242,
450
+ "eval_runtime": 4.1214,
451
+ "eval_samples_per_second": 69.394,
452
+ "eval_steps_per_second": 0.728,
453
+ "step": 152
454
+ },
455
+ {
456
+ "epoch": 48.0,
457
+ "eval_accuracy": 0.25874125874125875,
458
+ "eval_loss": 1.5235881805419922,
459
+ "eval_runtime": 4.2822,
460
+ "eval_samples_per_second": 66.789,
461
+ "eval_steps_per_second": 0.701,
462
+ "step": 156
463
+ },
464
+ {
465
+ "epoch": 48.92,
466
+ "eval_accuracy": 0.26573426573426573,
467
+ "eval_loss": 1.5250674486160278,
468
+ "eval_runtime": 6.0487,
469
+ "eval_samples_per_second": 47.283,
470
+ "eval_steps_per_second": 0.496,
471
+ "step": 159
472
+ },
473
+ {
474
+ "epoch": 49.85,
475
+ "eval_accuracy": 0.28321678321678323,
476
+ "eval_loss": 1.5259337425231934,
477
+ "eval_runtime": 4.1709,
478
+ "eval_samples_per_second": 68.571,
479
+ "eval_steps_per_second": 0.719,
480
+ "step": 162
481
+ },
482
+ {
483
+ "epoch": 50.77,
484
+ "eval_accuracy": 0.27972027972027974,
485
+ "eval_loss": 1.5261683464050293,
486
+ "eval_runtime": 4.3522,
487
+ "eval_samples_per_second": 65.713,
488
+ "eval_steps_per_second": 0.689,
489
+ "step": 165
490
+ },
491
+ {
492
+ "epoch": 52.0,
493
+ "eval_accuracy": 0.2937062937062937,
494
+ "eval_loss": 1.5248568058013916,
495
+ "eval_runtime": 4.8279,
496
+ "eval_samples_per_second": 59.24,
497
+ "eval_steps_per_second": 0.621,
498
+ "step": 169
499
+ },
500
+ {
501
+ "epoch": 52.92,
502
+ "eval_accuracy": 0.3006993006993007,
503
+ "eval_loss": 1.522719383239746,
504
+ "eval_runtime": 4.205,
505
+ "eval_samples_per_second": 68.014,
506
+ "eval_steps_per_second": 0.713,
507
+ "step": 172
508
+ },
509
+ {
510
+ "epoch": 53.85,
511
+ "eval_accuracy": 0.3076923076923077,
512
+ "eval_loss": 1.5189520120620728,
513
+ "eval_runtime": 5.4852,
514
+ "eval_samples_per_second": 52.14,
515
+ "eval_steps_per_second": 0.547,
516
+ "step": 175
517
+ },
518
+ {
519
+ "epoch": 54.77,
520
+ "eval_accuracy": 0.32167832167832167,
521
+ "eval_loss": 1.5137863159179688,
522
+ "eval_runtime": 4.3909,
523
+ "eval_samples_per_second": 65.134,
524
+ "eval_steps_per_second": 0.683,
525
+ "step": 178
526
+ },
527
+ {
528
+ "epoch": 56.0,
529
+ "eval_accuracy": 0.34965034965034963,
530
+ "eval_loss": 1.5053085088729858,
531
+ "eval_runtime": 4.0994,
532
+ "eval_samples_per_second": 69.766,
533
+ "eval_steps_per_second": 0.732,
534
+ "step": 182
535
+ },
536
+ {
537
+ "epoch": 56.92,
538
+ "eval_accuracy": 0.36013986013986016,
539
+ "eval_loss": 1.497667908668518,
540
+ "eval_runtime": 4.4275,
541
+ "eval_samples_per_second": 64.596,
542
+ "eval_steps_per_second": 0.678,
543
+ "step": 185
544
+ },
545
+ {
546
+ "epoch": 57.85,
547
+ "eval_accuracy": 0.36013986013986016,
548
+ "eval_loss": 1.4910008907318115,
549
+ "eval_runtime": 4.4713,
550
+ "eval_samples_per_second": 63.963,
551
+ "eval_steps_per_second": 0.671,
552
+ "step": 188
553
+ },
554
+ {
555
+ "epoch": 58.77,
556
+ "eval_accuracy": 0.36713286713286714,
557
+ "eval_loss": 1.4839717149734497,
558
+ "eval_runtime": 4.6741,
559
+ "eval_samples_per_second": 61.189,
560
+ "eval_steps_per_second": 0.642,
561
+ "step": 191
562
+ },
563
+ {
564
+ "epoch": 60.0,
565
+ "eval_accuracy": 0.3706293706293706,
566
+ "eval_loss": 1.4754726886749268,
567
+ "eval_runtime": 4.1736,
568
+ "eval_samples_per_second": 68.526,
569
+ "eval_steps_per_second": 0.719,
570
+ "step": 195
571
+ },
572
+ {
573
+ "epoch": 60.92,
574
+ "eval_accuracy": 0.3811188811188811,
575
+ "eval_loss": 1.4683842658996582,
576
+ "eval_runtime": 3.9445,
577
+ "eval_samples_per_second": 72.507,
578
+ "eval_steps_per_second": 0.761,
579
+ "step": 198
580
+ },
581
+ {
582
+ "epoch": 61.54,
583
+ "grad_norm": 0.41712912917137146,
584
+ "learning_rate": 2.6984126984126984e-05,
585
+ "loss": 1.2845,
586
+ "step": 200
587
+ },
588
+ {
589
+ "epoch": 61.85,
590
+ "eval_accuracy": 0.38461538461538464,
591
+ "eval_loss": 1.4626859426498413,
592
+ "eval_runtime": 4.7292,
593
+ "eval_samples_per_second": 60.475,
594
+ "eval_steps_per_second": 0.634,
595
+ "step": 201
596
+ },
597
+ {
598
+ "epoch": 62.77,
599
+ "eval_accuracy": 0.3881118881118881,
600
+ "eval_loss": 1.4546846151351929,
601
+ "eval_runtime": 4.5742,
602
+ "eval_samples_per_second": 62.524,
603
+ "eval_steps_per_second": 0.656,
604
+ "step": 204
605
+ },
606
+ {
607
+ "epoch": 64.0,
608
+ "eval_accuracy": 0.4020979020979021,
609
+ "eval_loss": 1.4456309080123901,
610
+ "eval_runtime": 4.1295,
611
+ "eval_samples_per_second": 69.259,
612
+ "eval_steps_per_second": 0.726,
613
+ "step": 208
614
+ },
615
+ {
616
+ "epoch": 64.92,
617
+ "eval_accuracy": 0.40559440559440557,
618
+ "eval_loss": 1.4385287761688232,
619
+ "eval_runtime": 4.9759,
620
+ "eval_samples_per_second": 57.477,
621
+ "eval_steps_per_second": 0.603,
622
+ "step": 211
623
+ },
624
+ {
625
+ "epoch": 65.85,
626
+ "eval_accuracy": 0.4090909090909091,
627
+ "eval_loss": 1.4315868616104126,
628
+ "eval_runtime": 4.7,
629
+ "eval_samples_per_second": 60.851,
630
+ "eval_steps_per_second": 0.638,
631
+ "step": 214
632
+ },
633
+ {
634
+ "epoch": 66.77,
635
+ "eval_accuracy": 0.4160839160839161,
636
+ "eval_loss": 1.423151969909668,
637
+ "eval_runtime": 4.1887,
638
+ "eval_samples_per_second": 68.28,
639
+ "eval_steps_per_second": 0.716,
640
+ "step": 217
641
+ },
642
+ {
643
+ "epoch": 68.0,
644
+ "eval_accuracy": 0.42657342657342656,
645
+ "eval_loss": 1.4132899045944214,
646
+ "eval_runtime": 6.2189,
647
+ "eval_samples_per_second": 45.989,
648
+ "eval_steps_per_second": 0.482,
649
+ "step": 221
650
+ },
651
+ {
652
+ "epoch": 68.92,
653
+ "eval_accuracy": 0.43006993006993005,
654
+ "eval_loss": 1.4061568975448608,
655
+ "eval_runtime": 5.3452,
656
+ "eval_samples_per_second": 53.506,
657
+ "eval_steps_per_second": 0.561,
658
+ "step": 224
659
+ },
660
+ {
661
+ "epoch": 69.85,
662
+ "eval_accuracy": 0.43356643356643354,
663
+ "eval_loss": 1.4003138542175293,
664
+ "eval_runtime": 5.111,
665
+ "eval_samples_per_second": 55.958,
666
+ "eval_steps_per_second": 0.587,
667
+ "step": 227
668
+ },
669
+ {
670
+ "epoch": 70.77,
671
+ "eval_accuracy": 0.43356643356643354,
672
+ "eval_loss": 1.396316647529602,
673
+ "eval_runtime": 4.6366,
674
+ "eval_samples_per_second": 61.683,
675
+ "eval_steps_per_second": 0.647,
676
+ "step": 230
677
+ },
678
+ {
679
+ "epoch": 72.0,
680
+ "eval_accuracy": 0.43356643356643354,
681
+ "eval_loss": 1.3880172967910767,
682
+ "eval_runtime": 4.6851,
683
+ "eval_samples_per_second": 61.045,
684
+ "eval_steps_per_second": 0.64,
685
+ "step": 234
686
+ },
687
+ {
688
+ "epoch": 72.92,
689
+ "eval_accuracy": 0.4370629370629371,
690
+ "eval_loss": 1.3800761699676514,
691
+ "eval_runtime": 4.5739,
692
+ "eval_samples_per_second": 62.528,
693
+ "eval_steps_per_second": 0.656,
694
+ "step": 237
695
+ },
696
+ {
697
+ "epoch": 73.85,
698
+ "eval_accuracy": 0.4405594405594406,
699
+ "eval_loss": 1.3724888563156128,
700
+ "eval_runtime": 4.9175,
701
+ "eval_samples_per_second": 58.16,
702
+ "eval_steps_per_second": 0.61,
703
+ "step": 240
704
+ },
705
+ {
706
+ "epoch": 74.77,
707
+ "eval_accuracy": 0.44755244755244755,
708
+ "eval_loss": 1.3655133247375488,
709
+ "eval_runtime": 5.0566,
710
+ "eval_samples_per_second": 56.559,
711
+ "eval_steps_per_second": 0.593,
712
+ "step": 243
713
+ },
714
+ {
715
+ "epoch": 76.0,
716
+ "eval_accuracy": 0.45104895104895104,
717
+ "eval_loss": 1.3560560941696167,
718
+ "eval_runtime": 3.592,
719
+ "eval_samples_per_second": 79.622,
720
+ "eval_steps_per_second": 0.835,
721
+ "step": 247
722
+ },
723
+ {
724
+ "epoch": 76.92,
725
+ "grad_norm": 0.3923046588897705,
726
+ "learning_rate": 2.5396825396825397e-05,
727
+ "loss": 1.1752,
728
+ "step": 250
729
+ },
730
+ {
731
+ "epoch": 76.92,
732
+ "eval_accuracy": 0.45454545454545453,
733
+ "eval_loss": 1.3477288484573364,
734
+ "eval_runtime": 5.2706,
735
+ "eval_samples_per_second": 54.264,
736
+ "eval_steps_per_second": 0.569,
737
+ "step": 250
738
+ },
739
+ {
740
+ "epoch": 77.85,
741
+ "eval_accuracy": 0.45454545454545453,
742
+ "eval_loss": 1.3385549783706665,
743
+ "eval_runtime": 4.3668,
744
+ "eval_samples_per_second": 65.494,
745
+ "eval_steps_per_second": 0.687,
746
+ "step": 253
747
+ },
748
+ {
749
+ "epoch": 78.77,
750
+ "eval_accuracy": 0.45454545454545453,
751
+ "eval_loss": 1.329953908920288,
752
+ "eval_runtime": 4.3715,
753
+ "eval_samples_per_second": 65.423,
754
+ "eval_steps_per_second": 0.686,
755
+ "step": 256
756
+ },
757
+ {
758
+ "epoch": 80.0,
759
+ "eval_accuracy": 0.46153846153846156,
760
+ "eval_loss": 1.3186790943145752,
761
+ "eval_runtime": 4.9164,
762
+ "eval_samples_per_second": 58.173,
763
+ "eval_steps_per_second": 0.61,
764
+ "step": 260
765
+ },
766
+ {
767
+ "epoch": 80.92,
768
+ "eval_accuracy": 0.47202797202797203,
769
+ "eval_loss": 1.3101806640625,
770
+ "eval_runtime": 4.5555,
771
+ "eval_samples_per_second": 62.782,
772
+ "eval_steps_per_second": 0.659,
773
+ "step": 263
774
+ },
775
+ {
776
+ "epoch": 81.85,
777
+ "eval_accuracy": 0.4755244755244755,
778
+ "eval_loss": 1.3015599250793457,
779
+ "eval_runtime": 3.7938,
780
+ "eval_samples_per_second": 75.387,
781
+ "eval_steps_per_second": 0.791,
782
+ "step": 266
783
+ },
784
+ {
785
+ "epoch": 82.77,
786
+ "eval_accuracy": 0.4825174825174825,
787
+ "eval_loss": 1.2916128635406494,
788
+ "eval_runtime": 3.4076,
789
+ "eval_samples_per_second": 83.931,
790
+ "eval_steps_per_second": 0.88,
791
+ "step": 269
792
+ },
793
+ {
794
+ "epoch": 84.0,
795
+ "eval_accuracy": 0.4825174825174825,
796
+ "eval_loss": 1.2802271842956543,
797
+ "eval_runtime": 3.947,
798
+ "eval_samples_per_second": 72.46,
799
+ "eval_steps_per_second": 0.76,
800
+ "step": 273
801
+ },
802
+ {
803
+ "epoch": 84.92,
804
+ "eval_accuracy": 0.486013986013986,
805
+ "eval_loss": 1.2717865705490112,
806
+ "eval_runtime": 4.6584,
807
+ "eval_samples_per_second": 61.394,
808
+ "eval_steps_per_second": 0.644,
809
+ "step": 276
810
+ },
811
+ {
812
+ "epoch": 85.85,
813
+ "eval_accuracy": 0.48951048951048953,
814
+ "eval_loss": 1.2625547647476196,
815
+ "eval_runtime": 3.7402,
816
+ "eval_samples_per_second": 76.466,
817
+ "eval_steps_per_second": 0.802,
818
+ "step": 279
819
+ },
820
+ {
821
+ "epoch": 86.77,
822
+ "eval_accuracy": 0.493006993006993,
823
+ "eval_loss": 1.2543796300888062,
824
+ "eval_runtime": 4.726,
825
+ "eval_samples_per_second": 60.516,
826
+ "eval_steps_per_second": 0.635,
827
+ "step": 282
828
+ },
829
+ {
830
+ "epoch": 88.0,
831
+ "eval_accuracy": 0.493006993006993,
832
+ "eval_loss": 1.2428691387176514,
833
+ "eval_runtime": 3.9492,
834
+ "eval_samples_per_second": 72.42,
835
+ "eval_steps_per_second": 0.76,
836
+ "step": 286
837
+ },
838
+ {
839
+ "epoch": 88.92,
840
+ "eval_accuracy": 0.4965034965034965,
841
+ "eval_loss": 1.2338002920150757,
842
+ "eval_runtime": 4.6146,
843
+ "eval_samples_per_second": 61.978,
844
+ "eval_steps_per_second": 0.65,
845
+ "step": 289
846
+ },
847
+ {
848
+ "epoch": 89.85,
849
+ "eval_accuracy": 0.5034965034965035,
850
+ "eval_loss": 1.223657488822937,
851
+ "eval_runtime": 4.7664,
852
+ "eval_samples_per_second": 60.003,
853
+ "eval_steps_per_second": 0.629,
854
+ "step": 292
855
+ },
856
+ {
857
+ "epoch": 90.77,
858
+ "eval_accuracy": 0.513986013986014,
859
+ "eval_loss": 1.2134180068969727,
860
+ "eval_runtime": 3.6509,
861
+ "eval_samples_per_second": 78.337,
862
+ "eval_steps_per_second": 0.822,
863
+ "step": 295
864
+ },
865
+ {
866
+ "epoch": 92.0,
867
+ "eval_accuracy": 0.5314685314685315,
868
+ "eval_loss": 1.1996746063232422,
869
+ "eval_runtime": 4.1379,
870
+ "eval_samples_per_second": 69.118,
871
+ "eval_steps_per_second": 0.725,
872
+ "step": 299
873
+ },
874
+ {
875
+ "epoch": 92.31,
876
+ "grad_norm": 0.4333157241344452,
877
+ "learning_rate": 2.380952380952381e-05,
878
+ "loss": 1.0336,
879
+ "step": 300
880
+ },
881
+ {
882
+ "epoch": 92.92,
883
+ "eval_accuracy": 0.534965034965035,
884
+ "eval_loss": 1.1893947124481201,
885
+ "eval_runtime": 4.3495,
886
+ "eval_samples_per_second": 65.755,
887
+ "eval_steps_per_second": 0.69,
888
+ "step": 302
889
+ },
890
+ {
891
+ "epoch": 93.85,
892
+ "eval_accuracy": 0.5524475524475524,
893
+ "eval_loss": 1.1794614791870117,
894
+ "eval_runtime": 5.0315,
895
+ "eval_samples_per_second": 56.842,
896
+ "eval_steps_per_second": 0.596,
897
+ "step": 305
898
+ },
899
+ {
900
+ "epoch": 94.77,
901
+ "eval_accuracy": 0.5629370629370629,
902
+ "eval_loss": 1.1703894138336182,
903
+ "eval_runtime": 4.5156,
904
+ "eval_samples_per_second": 63.336,
905
+ "eval_steps_per_second": 0.664,
906
+ "step": 308
907
+ },
908
+ {
909
+ "epoch": 96.0,
910
+ "eval_accuracy": 0.5629370629370629,
911
+ "eval_loss": 1.1574207544326782,
912
+ "eval_runtime": 4.2769,
913
+ "eval_samples_per_second": 66.871,
914
+ "eval_steps_per_second": 0.701,
915
+ "step": 312
916
+ },
917
+ {
918
+ "epoch": 96.92,
919
+ "eval_accuracy": 0.5804195804195804,
920
+ "eval_loss": 1.1478246450424194,
921
+ "eval_runtime": 4.4503,
922
+ "eval_samples_per_second": 64.266,
923
+ "eval_steps_per_second": 0.674,
924
+ "step": 315
925
+ },
926
+ {
927
+ "epoch": 97.85,
928
+ "eval_accuracy": 0.583916083916084,
929
+ "eval_loss": 1.1388368606567383,
930
+ "eval_runtime": 5.2516,
931
+ "eval_samples_per_second": 54.46,
932
+ "eval_steps_per_second": 0.571,
933
+ "step": 318
934
+ },
935
+ {
936
+ "epoch": 98.77,
937
+ "eval_accuracy": 0.5874125874125874,
938
+ "eval_loss": 1.129955530166626,
939
+ "eval_runtime": 4.5307,
940
+ "eval_samples_per_second": 63.125,
941
+ "eval_steps_per_second": 0.662,
942
+ "step": 321
943
+ },
944
+ {
945
+ "epoch": 100.0,
946
+ "eval_accuracy": 0.5944055944055944,
947
+ "eval_loss": 1.1171796321868896,
948
+ "eval_runtime": 4.5358,
949
+ "eval_samples_per_second": 63.054,
950
+ "eval_steps_per_second": 0.661,
951
+ "step": 325
952
+ },
953
+ {
954
+ "epoch": 100.92,
955
+ "eval_accuracy": 0.5979020979020979,
956
+ "eval_loss": 1.1089597940444946,
957
+ "eval_runtime": 4.7931,
958
+ "eval_samples_per_second": 59.669,
959
+ "eval_steps_per_second": 0.626,
960
+ "step": 328
961
+ },
962
+ {
963
+ "epoch": 101.85,
964
+ "eval_accuracy": 0.5944055944055944,
965
+ "eval_loss": 1.1001044511795044,
966
+ "eval_runtime": 4.4134,
967
+ "eval_samples_per_second": 64.802,
968
+ "eval_steps_per_second": 0.68,
969
+ "step": 331
970
+ },
971
+ {
972
+ "epoch": 102.77,
973
+ "eval_accuracy": 0.6048951048951049,
974
+ "eval_loss": 1.0910252332687378,
975
+ "eval_runtime": 4.8251,
976
+ "eval_samples_per_second": 59.273,
977
+ "eval_steps_per_second": 0.622,
978
+ "step": 334
979
+ },
980
+ {
981
+ "epoch": 104.0,
982
+ "eval_accuracy": 0.6013986013986014,
983
+ "eval_loss": 1.0768800973892212,
984
+ "eval_runtime": 5.528,
985
+ "eval_samples_per_second": 51.736,
986
+ "eval_steps_per_second": 0.543,
987
+ "step": 338
988
+ },
989
+ {
990
+ "epoch": 104.92,
991
+ "eval_accuracy": 0.6048951048951049,
992
+ "eval_loss": 1.0675218105316162,
993
+ "eval_runtime": 3.5589,
994
+ "eval_samples_per_second": 80.362,
995
+ "eval_steps_per_second": 0.843,
996
+ "step": 341
997
+ },
998
+ {
999
+ "epoch": 105.85,
1000
+ "eval_accuracy": 0.6118881118881119,
1001
+ "eval_loss": 1.0602259635925293,
1002
+ "eval_runtime": 4.2603,
1003
+ "eval_samples_per_second": 67.132,
1004
+ "eval_steps_per_second": 0.704,
1005
+ "step": 344
1006
+ },
1007
+ {
1008
+ "epoch": 106.77,
1009
+ "eval_accuracy": 0.6153846153846154,
1010
+ "eval_loss": 1.0537227392196655,
1011
+ "eval_runtime": 4.4326,
1012
+ "eval_samples_per_second": 64.521,
1013
+ "eval_steps_per_second": 0.677,
1014
+ "step": 347
1015
+ },
1016
+ {
1017
+ "epoch": 107.69,
1018
+ "grad_norm": 0.46974265575408936,
1019
+ "learning_rate": 2.222222222222222e-05,
1020
+ "loss": 0.8927,
1021
+ "step": 350
1022
+ },
1023
+ {
1024
+ "epoch": 108.0,
1025
+ "eval_accuracy": 0.6223776223776224,
1026
+ "eval_loss": 1.045584797859192,
1027
+ "eval_runtime": 3.8481,
1028
+ "eval_samples_per_second": 74.323,
1029
+ "eval_steps_per_second": 0.78,
1030
+ "step": 351
1031
+ },
1032
+ {
1033
+ "epoch": 108.92,
1034
+ "eval_accuracy": 0.6293706293706294,
1035
+ "eval_loss": 1.0394147634506226,
1036
+ "eval_runtime": 4.6438,
1037
+ "eval_samples_per_second": 61.588,
1038
+ "eval_steps_per_second": 0.646,
1039
+ "step": 354
1040
+ },
1041
+ {
1042
+ "epoch": 109.85,
1043
+ "eval_accuracy": 0.6258741258741258,
1044
+ "eval_loss": 1.0330853462219238,
1045
+ "eval_runtime": 4.1627,
1046
+ "eval_samples_per_second": 68.706,
1047
+ "eval_steps_per_second": 0.721,
1048
+ "step": 357
1049
+ },
1050
+ {
1051
+ "epoch": 110.77,
1052
+ "eval_accuracy": 0.6258741258741258,
1053
+ "eval_loss": 1.0267359018325806,
1054
+ "eval_runtime": 4.5108,
1055
+ "eval_samples_per_second": 63.403,
1056
+ "eval_steps_per_second": 0.665,
1057
+ "step": 360
1058
+ },
1059
+ {
1060
+ "epoch": 112.0,
1061
+ "eval_accuracy": 0.6328671328671329,
1062
+ "eval_loss": 1.0192536115646362,
1063
+ "eval_runtime": 4.9039,
1064
+ "eval_samples_per_second": 58.321,
1065
+ "eval_steps_per_second": 0.612,
1066
+ "step": 364
1067
+ },
1068
+ {
1069
+ "epoch": 112.92,
1070
+ "eval_accuracy": 0.6363636363636364,
1071
+ "eval_loss": 1.0148723125457764,
1072
+ "eval_runtime": 3.8444,
1073
+ "eval_samples_per_second": 74.393,
1074
+ "eval_steps_per_second": 0.78,
1075
+ "step": 367
1076
+ },
1077
+ {
1078
+ "epoch": 113.85,
1079
+ "eval_accuracy": 0.6363636363636364,
1080
+ "eval_loss": 1.0099798440933228,
1081
+ "eval_runtime": 5.0977,
1082
+ "eval_samples_per_second": 56.104,
1083
+ "eval_steps_per_second": 0.589,
1084
+ "step": 370
1085
+ },
1086
+ {
1087
+ "epoch": 114.77,
1088
+ "eval_accuracy": 0.6398601398601399,
1089
+ "eval_loss": 1.0047037601470947,
1090
+ "eval_runtime": 4.837,
1091
+ "eval_samples_per_second": 59.128,
1092
+ "eval_steps_per_second": 0.62,
1093
+ "step": 373
1094
+ },
1095
+ {
1096
+ "epoch": 116.0,
1097
+ "eval_accuracy": 0.6398601398601399,
1098
+ "eval_loss": 0.9991178512573242,
1099
+ "eval_runtime": 4.9051,
1100
+ "eval_samples_per_second": 58.307,
1101
+ "eval_steps_per_second": 0.612,
1102
+ "step": 377
1103
+ },
1104
+ {
1105
+ "epoch": 116.92,
1106
+ "eval_accuracy": 0.6433566433566433,
1107
+ "eval_loss": 0.9972890615463257,
1108
+ "eval_runtime": 4.3405,
1109
+ "eval_samples_per_second": 65.891,
1110
+ "eval_steps_per_second": 0.691,
1111
+ "step": 380
1112
+ },
1113
+ {
1114
+ "epoch": 117.85,
1115
+ "eval_accuracy": 0.6433566433566433,
1116
+ "eval_loss": 0.9936119914054871,
1117
+ "eval_runtime": 3.9596,
1118
+ "eval_samples_per_second": 72.229,
1119
+ "eval_steps_per_second": 0.758,
1120
+ "step": 383
1121
+ },
1122
+ {
1123
+ "epoch": 118.77,
1124
+ "eval_accuracy": 0.6433566433566433,
1125
+ "eval_loss": 0.9908724427223206,
1126
+ "eval_runtime": 4.961,
1127
+ "eval_samples_per_second": 57.65,
1128
+ "eval_steps_per_second": 0.605,
1129
+ "step": 386
1130
+ },
1131
+ {
1132
+ "epoch": 120.0,
1133
+ "eval_accuracy": 0.6433566433566433,
1134
+ "eval_loss": 0.9878212213516235,
1135
+ "eval_runtime": 4.8469,
1136
+ "eval_samples_per_second": 59.006,
1137
+ "eval_steps_per_second": 0.619,
1138
+ "step": 390
1139
+ },
1140
+ {
1141
+ "epoch": 120.92,
1142
+ "eval_accuracy": 0.6468531468531469,
1143
+ "eval_loss": 0.9840787053108215,
1144
+ "eval_runtime": 4.5014,
1145
+ "eval_samples_per_second": 63.536,
1146
+ "eval_steps_per_second": 0.666,
1147
+ "step": 393
1148
+ },
1149
+ {
1150
+ "epoch": 121.85,
1151
+ "eval_accuracy": 0.6468531468531469,
1152
+ "eval_loss": 0.9810080528259277,
1153
+ "eval_runtime": 3.7722,
1154
+ "eval_samples_per_second": 75.818,
1155
+ "eval_steps_per_second": 0.795,
1156
+ "step": 396
1157
+ },
1158
+ {
1159
+ "epoch": 122.77,
1160
+ "eval_accuracy": 0.6503496503496503,
1161
+ "eval_loss": 0.9769043922424316,
1162
+ "eval_runtime": 4.713,
1163
+ "eval_samples_per_second": 60.684,
1164
+ "eval_steps_per_second": 0.637,
1165
+ "step": 399
1166
+ },
1167
+ {
1168
+ "epoch": 123.08,
1169
+ "grad_norm": 0.48339083790779114,
1170
+ "learning_rate": 2.0634920634920633e-05,
1171
+ "loss": 0.7859,
1172
+ "step": 400
1173
+ },
1174
+ {
1175
+ "epoch": 124.0,
1176
+ "eval_accuracy": 0.6538461538461539,
1177
+ "eval_loss": 0.9750482439994812,
1178
+ "eval_runtime": 4.9657,
1179
+ "eval_samples_per_second": 57.595,
1180
+ "eval_steps_per_second": 0.604,
1181
+ "step": 403
1182
+ },
1183
+ {
1184
+ "epoch": 124.92,
1185
+ "eval_accuracy": 0.6538461538461539,
1186
+ "eval_loss": 0.9752389192581177,
1187
+ "eval_runtime": 4.6155,
1188
+ "eval_samples_per_second": 61.965,
1189
+ "eval_steps_per_second": 0.65,
1190
+ "step": 406
1191
+ },
1192
+ {
1193
+ "epoch": 125.85,
1194
+ "eval_accuracy": 0.6468531468531469,
1195
+ "eval_loss": 0.975228488445282,
1196
+ "eval_runtime": 4.2181,
1197
+ "eval_samples_per_second": 67.803,
1198
+ "eval_steps_per_second": 0.711,
1199
+ "step": 409
1200
+ },
1201
+ {
1202
+ "epoch": 126.77,
1203
+ "eval_accuracy": 0.6468531468531469,
1204
+ "eval_loss": 0.973861575126648,
1205
+ "eval_runtime": 5.1633,
1206
+ "eval_samples_per_second": 55.391,
1207
+ "eval_steps_per_second": 0.581,
1208
+ "step": 412
1209
+ },
1210
+ {
1211
+ "epoch": 128.0,
1212
+ "eval_accuracy": 0.6433566433566433,
1213
+ "eval_loss": 0.9697291254997253,
1214
+ "eval_runtime": 3.8938,
1215
+ "eval_samples_per_second": 73.451,
1216
+ "eval_steps_per_second": 0.77,
1217
+ "step": 416
1218
+ },
1219
+ {
1220
+ "epoch": 128.92,
1221
+ "eval_accuracy": 0.6468531468531469,
1222
+ "eval_loss": 0.9673418998718262,
1223
+ "eval_runtime": 4.9929,
1224
+ "eval_samples_per_second": 57.282,
1225
+ "eval_steps_per_second": 0.601,
1226
+ "step": 419
1227
+ },
1228
+ {
1229
+ "epoch": 129.85,
1230
+ "eval_accuracy": 0.6468531468531469,
1231
+ "eval_loss": 0.9654524922370911,
1232
+ "eval_runtime": 4.8097,
1233
+ "eval_samples_per_second": 59.463,
1234
+ "eval_steps_per_second": 0.624,
1235
+ "step": 422
1236
+ },
1237
+ {
1238
+ "epoch": 130.77,
1239
+ "eval_accuracy": 0.6468531468531469,
1240
+ "eval_loss": 0.9648922085762024,
1241
+ "eval_runtime": 4.6728,
1242
+ "eval_samples_per_second": 61.205,
1243
+ "eval_steps_per_second": 0.642,
1244
+ "step": 425
1245
+ },
1246
+ {
1247
+ "epoch": 132.0,
1248
+ "eval_accuracy": 0.6503496503496503,
1249
+ "eval_loss": 0.9624325633049011,
1250
+ "eval_runtime": 3.9139,
1251
+ "eval_samples_per_second": 73.073,
1252
+ "eval_steps_per_second": 0.766,
1253
+ "step": 429
1254
+ },
1255
+ {
1256
+ "epoch": 132.92,
1257
+ "eval_accuracy": 0.6503496503496503,
1258
+ "eval_loss": 0.960906445980072,
1259
+ "eval_runtime": 5.0181,
1260
+ "eval_samples_per_second": 56.994,
1261
+ "eval_steps_per_second": 0.598,
1262
+ "step": 432
1263
+ },
1264
+ {
1265
+ "epoch": 133.85,
1266
+ "eval_accuracy": 0.6468531468531469,
1267
+ "eval_loss": 0.958863377571106,
1268
+ "eval_runtime": 4.172,
1269
+ "eval_samples_per_second": 68.552,
1270
+ "eval_steps_per_second": 0.719,
1271
+ "step": 435
1272
+ },
1273
+ {
1274
+ "epoch": 134.77,
1275
+ "eval_accuracy": 0.6468531468531469,
1276
+ "eval_loss": 0.9576795697212219,
1277
+ "eval_runtime": 5.1205,
1278
+ "eval_samples_per_second": 55.854,
1279
+ "eval_steps_per_second": 0.586,
1280
+ "step": 438
1281
+ },
1282
+ {
1283
+ "epoch": 136.0,
1284
+ "eval_accuracy": 0.6503496503496503,
1285
+ "eval_loss": 0.9575643539428711,
1286
+ "eval_runtime": 3.9439,
1287
+ "eval_samples_per_second": 72.517,
1288
+ "eval_steps_per_second": 0.761,
1289
+ "step": 442
1290
+ },
1291
+ {
1292
+ "epoch": 136.92,
1293
+ "eval_accuracy": 0.6468531468531469,
1294
+ "eval_loss": 0.9587862491607666,
1295
+ "eval_runtime": 4.289,
1296
+ "eval_samples_per_second": 66.682,
1297
+ "eval_steps_per_second": 0.699,
1298
+ "step": 445
1299
+ },
1300
+ {
1301
+ "epoch": 137.85,
1302
+ "eval_accuracy": 0.6503496503496503,
1303
+ "eval_loss": 0.9579612016677856,
1304
+ "eval_runtime": 4.3725,
1305
+ "eval_samples_per_second": 65.409,
1306
+ "eval_steps_per_second": 0.686,
1307
+ "step": 448
1308
+ },
1309
+ {
1310
+ "epoch": 138.46,
1311
+ "grad_norm": 0.5380613803863525,
1312
+ "learning_rate": 1.9047619047619046e-05,
1313
+ "loss": 0.7428,
1314
+ "step": 450
1315
+ },
1316
+ {
1317
+ "epoch": 138.77,
1318
+ "eval_accuracy": 0.6468531468531469,
1319
+ "eval_loss": 0.9572532176971436,
1320
+ "eval_runtime": 4.4425,
1321
+ "eval_samples_per_second": 64.378,
1322
+ "eval_steps_per_second": 0.675,
1323
+ "step": 451
1324
+ },
1325
+ {
1326
+ "epoch": 140.0,
1327
+ "eval_accuracy": 0.6468531468531469,
1328
+ "eval_loss": 0.9572116732597351,
1329
+ "eval_runtime": 5.4248,
1330
+ "eval_samples_per_second": 52.721,
1331
+ "eval_steps_per_second": 0.553,
1332
+ "step": 455
1333
+ },
1334
+ {
1335
+ "epoch": 140.92,
1336
+ "eval_accuracy": 0.6468531468531469,
1337
+ "eval_loss": 0.9591361284255981,
1338
+ "eval_runtime": 4.4268,
1339
+ "eval_samples_per_second": 64.606,
1340
+ "eval_steps_per_second": 0.678,
1341
+ "step": 458
1342
+ },
1343
+ {
1344
+ "epoch": 141.85,
1345
+ "eval_accuracy": 0.6468531468531469,
1346
+ "eval_loss": 0.9620410203933716,
1347
+ "eval_runtime": 5.1983,
1348
+ "eval_samples_per_second": 55.018,
1349
+ "eval_steps_per_second": 0.577,
1350
+ "step": 461
1351
+ },
1352
+ {
1353
+ "epoch": 142.77,
1354
+ "eval_accuracy": 0.6503496503496503,
1355
+ "eval_loss": 0.9638076424598694,
1356
+ "eval_runtime": 4.2721,
1357
+ "eval_samples_per_second": 66.945,
1358
+ "eval_steps_per_second": 0.702,
1359
+ "step": 464
1360
+ },
1361
+ {
1362
+ "epoch": 144.0,
1363
+ "eval_accuracy": 0.6503496503496503,
1364
+ "eval_loss": 0.9598986506462097,
1365
+ "eval_runtime": 4.7252,
1366
+ "eval_samples_per_second": 60.527,
1367
+ "eval_steps_per_second": 0.635,
1368
+ "step": 468
1369
+ },
1370
+ {
1371
+ "epoch": 144.92,
1372
+ "eval_accuracy": 0.6573426573426573,
1373
+ "eval_loss": 0.9564277529716492,
1374
+ "eval_runtime": 4.3597,
1375
+ "eval_samples_per_second": 65.601,
1376
+ "eval_steps_per_second": 0.688,
1377
+ "step": 471
1378
+ },
1379
+ {
1380
+ "epoch": 145.85,
1381
+ "eval_accuracy": 0.6538461538461539,
1382
+ "eval_loss": 0.9549375176429749,
1383
+ "eval_runtime": 4.7228,
1384
+ "eval_samples_per_second": 60.558,
1385
+ "eval_steps_per_second": 0.635,
1386
+ "step": 474
1387
+ },
1388
+ {
1389
+ "epoch": 146.77,
1390
+ "eval_accuracy": 0.6468531468531469,
1391
+ "eval_loss": 0.9566131830215454,
1392
+ "eval_runtime": 4.5206,
1393
+ "eval_samples_per_second": 63.267,
1394
+ "eval_steps_per_second": 0.664,
1395
+ "step": 477
1396
+ },
1397
+ {
1398
+ "epoch": 148.0,
1399
+ "eval_accuracy": 0.6538461538461539,
1400
+ "eval_loss": 0.9600043892860413,
1401
+ "eval_runtime": 4.5711,
1402
+ "eval_samples_per_second": 62.567,
1403
+ "eval_steps_per_second": 0.656,
1404
+ "step": 481
1405
+ },
1406
+ {
1407
+ "epoch": 148.92,
1408
+ "eval_accuracy": 0.6573426573426573,
1409
+ "eval_loss": 0.9608636498451233,
1410
+ "eval_runtime": 4.4191,
1411
+ "eval_samples_per_second": 64.719,
1412
+ "eval_steps_per_second": 0.679,
1413
+ "step": 484
1414
+ },
1415
+ {
1416
+ "epoch": 149.85,
1417
+ "eval_accuracy": 0.6573426573426573,
1418
+ "eval_loss": 0.958177387714386,
1419
+ "eval_runtime": 5.4181,
1420
+ "eval_samples_per_second": 52.786,
1421
+ "eval_steps_per_second": 0.554,
1422
+ "step": 487
1423
+ },
1424
+ {
1425
+ "epoch": 150.77,
1426
+ "eval_accuracy": 0.6573426573426573,
1427
+ "eval_loss": 0.9540855288505554,
1428
+ "eval_runtime": 4.3306,
1429
+ "eval_samples_per_second": 66.041,
1430
+ "eval_steps_per_second": 0.693,
1431
+ "step": 490
1432
+ },
1433
+ {
1434
+ "epoch": 152.0,
1435
+ "eval_accuracy": 0.6573426573426573,
1436
+ "eval_loss": 0.955094575881958,
1437
+ "eval_runtime": 4.3124,
1438
+ "eval_samples_per_second": 66.32,
1439
+ "eval_steps_per_second": 0.696,
1440
+ "step": 494
1441
+ },
1442
+ {
1443
+ "epoch": 152.92,
1444
+ "eval_accuracy": 0.6538461538461539,
1445
+ "eval_loss": 0.9549675583839417,
1446
+ "eval_runtime": 5.2148,
1447
+ "eval_samples_per_second": 54.844,
1448
+ "eval_steps_per_second": 0.575,
1449
+ "step": 497
1450
+ },
1451
+ {
1452
+ "epoch": 153.85,
1453
+ "grad_norm": 0.44109636545181274,
1454
+ "learning_rate": 1.746031746031746e-05,
1455
+ "loss": 0.7119,
1456
+ "step": 500
1457
+ },
1458
+ {
1459
+ "epoch": 153.85,
1460
+ "eval_accuracy": 0.6608391608391608,
1461
+ "eval_loss": 0.9533360600471497,
1462
+ "eval_runtime": 4.9161,
1463
+ "eval_samples_per_second": 58.177,
1464
+ "eval_steps_per_second": 0.61,
1465
+ "step": 500
1466
+ },
1467
+ {
1468
+ "epoch": 154.77,
1469
+ "eval_accuracy": 0.6608391608391608,
1470
+ "eval_loss": 0.9527105689048767,
1471
+ "eval_runtime": 4.9344,
1472
+ "eval_samples_per_second": 57.96,
1473
+ "eval_steps_per_second": 0.608,
1474
+ "step": 503
1475
+ },
1476
+ {
1477
+ "epoch": 156.0,
1478
+ "eval_accuracy": 0.6538461538461539,
1479
+ "eval_loss": 0.9555291533470154,
1480
+ "eval_runtime": 4.0853,
1481
+ "eval_samples_per_second": 70.008,
1482
+ "eval_steps_per_second": 0.734,
1483
+ "step": 507
1484
+ },
1485
+ {
1486
+ "epoch": 156.92,
1487
+ "eval_accuracy": 0.6608391608391608,
1488
+ "eval_loss": 0.9557806849479675,
1489
+ "eval_runtime": 4.5929,
1490
+ "eval_samples_per_second": 62.27,
1491
+ "eval_steps_per_second": 0.653,
1492
+ "step": 510
1493
+ },
1494
+ {
1495
+ "epoch": 157.85,
1496
+ "eval_accuracy": 0.6573426573426573,
1497
+ "eval_loss": 0.9578056931495667,
1498
+ "eval_runtime": 4.7785,
1499
+ "eval_samples_per_second": 59.851,
1500
+ "eval_steps_per_second": 0.628,
1501
+ "step": 513
1502
+ },
1503
+ {
1504
+ "epoch": 158.77,
1505
+ "eval_accuracy": 0.6573426573426573,
1506
+ "eval_loss": 0.9589922428131104,
1507
+ "eval_runtime": 3.9453,
1508
+ "eval_samples_per_second": 72.491,
1509
+ "eval_steps_per_second": 0.76,
1510
+ "step": 516
1511
+ },
1512
+ {
1513
+ "epoch": 160.0,
1514
+ "eval_accuracy": 0.6573426573426573,
1515
+ "eval_loss": 0.9553244113922119,
1516
+ "eval_runtime": 4.0583,
1517
+ "eval_samples_per_second": 70.473,
1518
+ "eval_steps_per_second": 0.739,
1519
+ "step": 520
1520
+ },
1521
+ {
1522
+ "epoch": 160.92,
1523
+ "eval_accuracy": 0.6573426573426573,
1524
+ "eval_loss": 0.9509897232055664,
1525
+ "eval_runtime": 4.3977,
1526
+ "eval_samples_per_second": 65.034,
1527
+ "eval_steps_per_second": 0.682,
1528
+ "step": 523
1529
+ },
1530
+ {
1531
+ "epoch": 161.85,
1532
+ "eval_accuracy": 0.6608391608391608,
1533
+ "eval_loss": 0.9446966052055359,
1534
+ "eval_runtime": 4.6204,
1535
+ "eval_samples_per_second": 61.899,
1536
+ "eval_steps_per_second": 0.649,
1537
+ "step": 526
1538
+ },
1539
+ {
1540
+ "epoch": 162.77,
1541
+ "eval_accuracy": 0.6608391608391608,
1542
+ "eval_loss": 0.9404750466346741,
1543
+ "eval_runtime": 4.132,
1544
+ "eval_samples_per_second": 69.216,
1545
+ "eval_steps_per_second": 0.726,
1546
+ "step": 529
1547
+ },
1548
+ {
1549
+ "epoch": 164.0,
1550
+ "eval_accuracy": 0.6608391608391608,
1551
+ "eval_loss": 0.9428921341896057,
1552
+ "eval_runtime": 4.3506,
1553
+ "eval_samples_per_second": 65.738,
1554
+ "eval_steps_per_second": 0.69,
1555
+ "step": 533
1556
+ },
1557
+ {
1558
+ "epoch": 164.92,
1559
+ "eval_accuracy": 0.6608391608391608,
1560
+ "eval_loss": 0.9472917914390564,
1561
+ "eval_runtime": 4.0197,
1562
+ "eval_samples_per_second": 71.15,
1563
+ "eval_steps_per_second": 0.746,
1564
+ "step": 536
1565
+ },
1566
+ {
1567
+ "epoch": 165.85,
1568
+ "eval_accuracy": 0.6608391608391608,
1569
+ "eval_loss": 0.952194333076477,
1570
+ "eval_runtime": 4.7031,
1571
+ "eval_samples_per_second": 60.811,
1572
+ "eval_steps_per_second": 0.638,
1573
+ "step": 539
1574
+ },
1575
+ {
1576
+ "epoch": 166.77,
1577
+ "eval_accuracy": 0.6608391608391608,
1578
+ "eval_loss": 0.9533052444458008,
1579
+ "eval_runtime": 4.3489,
1580
+ "eval_samples_per_second": 65.764,
1581
+ "eval_steps_per_second": 0.69,
1582
+ "step": 542
1583
+ },
1584
+ {
1585
+ "epoch": 168.0,
1586
+ "eval_accuracy": 0.6643356643356644,
1587
+ "eval_loss": 0.9497887492179871,
1588
+ "eval_runtime": 4.2573,
1589
+ "eval_samples_per_second": 67.178,
1590
+ "eval_steps_per_second": 0.705,
1591
+ "step": 546
1592
+ },
1593
+ {
1594
+ "epoch": 168.92,
1595
+ "eval_accuracy": 0.6608391608391608,
1596
+ "eval_loss": 0.9472330808639526,
1597
+ "eval_runtime": 4.4709,
1598
+ "eval_samples_per_second": 63.969,
1599
+ "eval_steps_per_second": 0.671,
1600
+ "step": 549
1601
+ },
1602
+ {
1603
+ "epoch": 169.23,
1604
+ "grad_norm": 0.8247159123420715,
1605
+ "learning_rate": 1.5873015873015872e-05,
1606
+ "loss": 0.6802,
1607
+ "step": 550
1608
+ },
1609
+ {
1610
+ "epoch": 169.85,
1611
+ "eval_accuracy": 0.6608391608391608,
1612
+ "eval_loss": 0.9484440684318542,
1613
+ "eval_runtime": 4.8437,
1614
+ "eval_samples_per_second": 59.046,
1615
+ "eval_steps_per_second": 0.619,
1616
+ "step": 552
1617
+ },
1618
+ {
1619
+ "epoch": 170.77,
1620
+ "eval_accuracy": 0.6608391608391608,
1621
+ "eval_loss": 0.948759913444519,
1622
+ "eval_runtime": 4.0675,
1623
+ "eval_samples_per_second": 70.313,
1624
+ "eval_steps_per_second": 0.738,
1625
+ "step": 555
1626
+ },
1627
+ {
1628
+ "epoch": 172.0,
1629
+ "eval_accuracy": 0.6608391608391608,
1630
+ "eval_loss": 0.9508001208305359,
1631
+ "eval_runtime": 4.1371,
1632
+ "eval_samples_per_second": 69.13,
1633
+ "eval_steps_per_second": 0.725,
1634
+ "step": 559
1635
+ },
1636
+ {
1637
+ "epoch": 172.92,
1638
+ "eval_accuracy": 0.6608391608391608,
1639
+ "eval_loss": 0.9550370573997498,
1640
+ "eval_runtime": 5.1562,
1641
+ "eval_samples_per_second": 55.467,
1642
+ "eval_steps_per_second": 0.582,
1643
+ "step": 562
1644
+ },
1645
+ {
1646
+ "epoch": 173.85,
1647
+ "eval_accuracy": 0.6573426573426573,
1648
+ "eval_loss": 0.9578031301498413,
1649
+ "eval_runtime": 5.1826,
1650
+ "eval_samples_per_second": 55.185,
1651
+ "eval_steps_per_second": 0.579,
1652
+ "step": 565
1653
+ },
1654
+ {
1655
+ "epoch": 174.77,
1656
+ "eval_accuracy": 0.6538461538461539,
1657
+ "eval_loss": 0.9607414603233337,
1658
+ "eval_runtime": 3.9547,
1659
+ "eval_samples_per_second": 72.318,
1660
+ "eval_steps_per_second": 0.759,
1661
+ "step": 568
1662
+ },
1663
+ {
1664
+ "epoch": 176.0,
1665
+ "eval_accuracy": 0.6573426573426573,
1666
+ "eval_loss": 0.9589574933052063,
1667
+ "eval_runtime": 4.6913,
1668
+ "eval_samples_per_second": 60.963,
1669
+ "eval_steps_per_second": 0.639,
1670
+ "step": 572
1671
+ },
1672
+ {
1673
+ "epoch": 176.92,
1674
+ "eval_accuracy": 0.6608391608391608,
1675
+ "eval_loss": 0.9530745148658752,
1676
+ "eval_runtime": 4.4058,
1677
+ "eval_samples_per_second": 64.915,
1678
+ "eval_steps_per_second": 0.681,
1679
+ "step": 575
1680
+ },
1681
+ {
1682
+ "epoch": 177.85,
1683
+ "eval_accuracy": 0.6608391608391608,
1684
+ "eval_loss": 0.9497523903846741,
1685
+ "eval_runtime": 4.7135,
1686
+ "eval_samples_per_second": 60.677,
1687
+ "eval_steps_per_second": 0.636,
1688
+ "step": 578
1689
+ },
1690
+ {
1691
+ "epoch": 178.77,
1692
+ "eval_accuracy": 0.6608391608391608,
1693
+ "eval_loss": 0.9497215151786804,
1694
+ "eval_runtime": 4.021,
1695
+ "eval_samples_per_second": 71.127,
1696
+ "eval_steps_per_second": 0.746,
1697
+ "step": 581
1698
+ },
1699
+ {
1700
+ "epoch": 180.0,
1701
+ "eval_accuracy": 0.6573426573426573,
1702
+ "eval_loss": 0.9547012448310852,
1703
+ "eval_runtime": 4.666,
1704
+ "eval_samples_per_second": 61.295,
1705
+ "eval_steps_per_second": 0.643,
1706
+ "step": 585
1707
+ },
1708
+ {
1709
+ "epoch": 180.92,
1710
+ "eval_accuracy": 0.6573426573426573,
1711
+ "eval_loss": 0.9555142521858215,
1712
+ "eval_runtime": 4.1238,
1713
+ "eval_samples_per_second": 69.353,
1714
+ "eval_steps_per_second": 0.727,
1715
+ "step": 588
1716
+ },
1717
+ {
1718
+ "epoch": 181.85,
1719
+ "eval_accuracy": 0.6538461538461539,
1720
+ "eval_loss": 0.9561424255371094,
1721
+ "eval_runtime": 4.7157,
1722
+ "eval_samples_per_second": 60.648,
1723
+ "eval_steps_per_second": 0.636,
1724
+ "step": 591
1725
+ },
1726
+ {
1727
+ "epoch": 182.77,
1728
+ "eval_accuracy": 0.6573426573426573,
1729
+ "eval_loss": 0.9556129574775696,
1730
+ "eval_runtime": 4.9472,
1731
+ "eval_samples_per_second": 57.81,
1732
+ "eval_steps_per_second": 0.606,
1733
+ "step": 594
1734
+ },
1735
+ {
1736
+ "epoch": 184.0,
1737
+ "eval_accuracy": 0.6573426573426573,
1738
+ "eval_loss": 0.9521645307540894,
1739
+ "eval_runtime": 4.7357,
1740
+ "eval_samples_per_second": 60.393,
1741
+ "eval_steps_per_second": 0.633,
1742
+ "step": 598
1743
+ },
1744
+ {
1745
+ "epoch": 184.62,
1746
+ "grad_norm": 0.5078141689300537,
1747
+ "learning_rate": 1.4285714285714285e-05,
1748
+ "loss": 0.6609,
1749
+ "step": 600
1750
+ },
1751
+ {
1752
+ "epoch": 184.92,
1753
+ "eval_accuracy": 0.6573426573426573,
1754
+ "eval_loss": 0.9505414366722107,
1755
+ "eval_runtime": 4.6852,
1756
+ "eval_samples_per_second": 61.043,
1757
+ "eval_steps_per_second": 0.64,
1758
+ "step": 601
1759
+ },
1760
+ {
1761
+ "epoch": 185.85,
1762
+ "eval_accuracy": 0.6608391608391608,
1763
+ "eval_loss": 0.9508634805679321,
1764
+ "eval_runtime": 4.5463,
1765
+ "eval_samples_per_second": 62.908,
1766
+ "eval_steps_per_second": 0.66,
1767
+ "step": 604
1768
+ },
1769
+ {
1770
+ "epoch": 186.77,
1771
+ "eval_accuracy": 0.6608391608391608,
1772
+ "eval_loss": 0.9513095021247864,
1773
+ "eval_runtime": 4.6608,
1774
+ "eval_samples_per_second": 61.363,
1775
+ "eval_steps_per_second": 0.644,
1776
+ "step": 607
1777
+ },
1778
+ {
1779
+ "epoch": 188.0,
1780
+ "eval_accuracy": 0.6573426573426573,
1781
+ "eval_loss": 0.9521496891975403,
1782
+ "eval_runtime": 4.2761,
1783
+ "eval_samples_per_second": 66.883,
1784
+ "eval_steps_per_second": 0.702,
1785
+ "step": 611
1786
+ },
1787
+ {
1788
+ "epoch": 188.92,
1789
+ "eval_accuracy": 0.6573426573426573,
1790
+ "eval_loss": 0.9504989981651306,
1791
+ "eval_runtime": 4.2369,
1792
+ "eval_samples_per_second": 67.502,
1793
+ "eval_steps_per_second": 0.708,
1794
+ "step": 614
1795
+ },
1796
+ {
1797
+ "epoch": 189.85,
1798
+ "eval_accuracy": 0.6573426573426573,
1799
+ "eval_loss": 0.9491674304008484,
1800
+ "eval_runtime": 4.201,
1801
+ "eval_samples_per_second": 68.079,
1802
+ "eval_steps_per_second": 0.714,
1803
+ "step": 617
1804
+ },
1805
+ {
1806
+ "epoch": 190.77,
1807
+ "eval_accuracy": 0.6538461538461539,
1808
+ "eval_loss": 0.9477587938308716,
1809
+ "eval_runtime": 5.2893,
1810
+ "eval_samples_per_second": 54.071,
1811
+ "eval_steps_per_second": 0.567,
1812
+ "step": 620
1813
+ },
1814
+ {
1815
+ "epoch": 192.0,
1816
+ "eval_accuracy": 0.6538461538461539,
1817
+ "eval_loss": 0.9457892775535583,
1818
+ "eval_runtime": 4.1359,
1819
+ "eval_samples_per_second": 69.151,
1820
+ "eval_steps_per_second": 0.725,
1821
+ "step": 624
1822
+ },
1823
+ {
1824
+ "epoch": 192.92,
1825
+ "eval_accuracy": 0.6573426573426573,
1826
+ "eval_loss": 0.9427019953727722,
1827
+ "eval_runtime": 4.8485,
1828
+ "eval_samples_per_second": 58.987,
1829
+ "eval_steps_per_second": 0.619,
1830
+ "step": 627
1831
+ },
1832
+ {
1833
+ "epoch": 193.85,
1834
+ "eval_accuracy": 0.6608391608391608,
1835
+ "eval_loss": 0.9433549046516418,
1836
+ "eval_runtime": 4.4182,
1837
+ "eval_samples_per_second": 64.732,
1838
+ "eval_steps_per_second": 0.679,
1839
+ "step": 630
1840
+ },
1841
+ {
1842
+ "epoch": 194.77,
1843
+ "eval_accuracy": 0.6573426573426573,
1844
+ "eval_loss": 0.9444069862365723,
1845
+ "eval_runtime": 4.503,
1846
+ "eval_samples_per_second": 63.513,
1847
+ "eval_steps_per_second": 0.666,
1848
+ "step": 633
1849
+ },
1850
+ {
1851
+ "epoch": 196.0,
1852
+ "eval_accuracy": 0.6573426573426573,
1853
+ "eval_loss": 0.9477455615997314,
1854
+ "eval_runtime": 4.7047,
1855
+ "eval_samples_per_second": 60.79,
1856
+ "eval_steps_per_second": 0.638,
1857
+ "step": 637
1858
+ },
1859
+ {
1860
+ "epoch": 196.92,
1861
+ "eval_accuracy": 0.6573426573426573,
1862
+ "eval_loss": 0.948028564453125,
1863
+ "eval_runtime": 4.6368,
1864
+ "eval_samples_per_second": 61.681,
1865
+ "eval_steps_per_second": 0.647,
1866
+ "step": 640
1867
+ },
1868
+ {
1869
+ "epoch": 197.85,
1870
+ "eval_accuracy": 0.6573426573426573,
1871
+ "eval_loss": 0.9453917741775513,
1872
+ "eval_runtime": 4.5374,
1873
+ "eval_samples_per_second": 63.032,
1874
+ "eval_steps_per_second": 0.661,
1875
+ "step": 643
1876
+ },
1877
+ {
1878
+ "epoch": 198.77,
1879
+ "eval_accuracy": 0.6573426573426573,
1880
+ "eval_loss": 0.944375216960907,
1881
+ "eval_runtime": 4.3393,
1882
+ "eval_samples_per_second": 65.909,
1883
+ "eval_steps_per_second": 0.691,
1884
+ "step": 646
1885
+ },
1886
+ {
1887
+ "epoch": 200.0,
1888
+ "grad_norm": 0.6592119336128235,
1889
+ "learning_rate": 1.2698412698412699e-05,
1890
+ "loss": 0.6402,
1891
+ "step": 650
1892
+ },
1893
+ {
1894
+ "epoch": 200.0,
1895
+ "eval_accuracy": 0.6573426573426573,
1896
+ "eval_loss": 0.9393660426139832,
1897
+ "eval_runtime": 4.2917,
1898
+ "eval_samples_per_second": 66.64,
1899
+ "eval_steps_per_second": 0.699,
1900
+ "step": 650
1901
+ },
1902
+ {
1903
+ "epoch": 200.92,
1904
+ "eval_accuracy": 0.6573426573426573,
1905
+ "eval_loss": 0.9392969012260437,
1906
+ "eval_runtime": 4.6663,
1907
+ "eval_samples_per_second": 61.291,
1908
+ "eval_steps_per_second": 0.643,
1909
+ "step": 653
1910
+ },
1911
+ {
1912
+ "epoch": 201.85,
1913
+ "eval_accuracy": 0.6608391608391608,
1914
+ "eval_loss": 0.9408543705940247,
1915
+ "eval_runtime": 3.7675,
1916
+ "eval_samples_per_second": 75.912,
1917
+ "eval_steps_per_second": 0.796,
1918
+ "step": 656
1919
+ },
1920
+ {
1921
+ "epoch": 202.77,
1922
+ "eval_accuracy": 0.6608391608391608,
1923
+ "eval_loss": 0.9433931112289429,
1924
+ "eval_runtime": 4.0263,
1925
+ "eval_samples_per_second": 71.034,
1926
+ "eval_steps_per_second": 0.745,
1927
+ "step": 659
1928
+ },
1929
+ {
1930
+ "epoch": 204.0,
1931
+ "eval_accuracy": 0.6608391608391608,
1932
+ "eval_loss": 0.9422336220741272,
1933
+ "eval_runtime": 5.0827,
1934
+ "eval_samples_per_second": 56.27,
1935
+ "eval_steps_per_second": 0.59,
1936
+ "step": 663
1937
+ },
1938
+ {
1939
+ "epoch": 204.92,
1940
+ "eval_accuracy": 0.6608391608391608,
1941
+ "eval_loss": 0.9422111511230469,
1942
+ "eval_runtime": 4.3449,
1943
+ "eval_samples_per_second": 65.824,
1944
+ "eval_steps_per_second": 0.69,
1945
+ "step": 666
1946
+ },
1947
+ {
1948
+ "epoch": 205.85,
1949
+ "eval_accuracy": 0.6608391608391608,
1950
+ "eval_loss": 0.9415052533149719,
1951
+ "eval_runtime": 4.3877,
1952
+ "eval_samples_per_second": 65.183,
1953
+ "eval_steps_per_second": 0.684,
1954
+ "step": 669
1955
+ },
1956
+ {
1957
+ "epoch": 206.77,
1958
+ "eval_accuracy": 0.6608391608391608,
1959
+ "eval_loss": 0.9403449892997742,
1960
+ "eval_runtime": 4.5384,
1961
+ "eval_samples_per_second": 63.018,
1962
+ "eval_steps_per_second": 0.661,
1963
+ "step": 672
1964
+ },
1965
+ {
1966
+ "epoch": 208.0,
1967
+ "eval_accuracy": 0.6573426573426573,
1968
+ "eval_loss": 0.9443973898887634,
1969
+ "eval_runtime": 4.8712,
1970
+ "eval_samples_per_second": 58.713,
1971
+ "eval_steps_per_second": 0.616,
1972
+ "step": 676
1973
+ },
1974
+ {
1975
+ "epoch": 208.92,
1976
+ "eval_accuracy": 0.6573426573426573,
1977
+ "eval_loss": 0.9434468746185303,
1978
+ "eval_runtime": 4.5262,
1979
+ "eval_samples_per_second": 63.188,
1980
+ "eval_steps_per_second": 0.663,
1981
+ "step": 679
1982
+ },
1983
+ {
1984
+ "epoch": 209.85,
1985
+ "eval_accuracy": 0.6608391608391608,
1986
+ "eval_loss": 0.9392986297607422,
1987
+ "eval_runtime": 3.8813,
1988
+ "eval_samples_per_second": 73.687,
1989
+ "eval_steps_per_second": 0.773,
1990
+ "step": 682
1991
+ },
1992
+ {
1993
+ "epoch": 210.77,
1994
+ "eval_accuracy": 0.6573426573426573,
1995
+ "eval_loss": 0.9383959174156189,
1996
+ "eval_runtime": 4.0949,
1997
+ "eval_samples_per_second": 69.843,
1998
+ "eval_steps_per_second": 0.733,
1999
+ "step": 685
2000
+ },
2001
+ {
2002
+ "epoch": 212.0,
2003
+ "eval_accuracy": 0.6573426573426573,
2004
+ "eval_loss": 0.9405562281608582,
2005
+ "eval_runtime": 4.0071,
2006
+ "eval_samples_per_second": 71.374,
2007
+ "eval_steps_per_second": 0.749,
2008
+ "step": 689
2009
+ },
2010
+ {
2011
+ "epoch": 212.92,
2012
+ "eval_accuracy": 0.6573426573426573,
2013
+ "eval_loss": 0.9427996873855591,
2014
+ "eval_runtime": 4.4042,
2015
+ "eval_samples_per_second": 64.938,
2016
+ "eval_steps_per_second": 0.681,
2017
+ "step": 692
2018
+ },
2019
+ {
2020
+ "epoch": 213.85,
2021
+ "eval_accuracy": 0.6573426573426573,
2022
+ "eval_loss": 0.9420264363288879,
2023
+ "eval_runtime": 5.0628,
2024
+ "eval_samples_per_second": 56.491,
2025
+ "eval_steps_per_second": 0.593,
2026
+ "step": 695
2027
+ },
2028
+ {
2029
+ "epoch": 214.77,
2030
+ "eval_accuracy": 0.6538461538461539,
2031
+ "eval_loss": 0.9402673840522766,
2032
+ "eval_runtime": 4.5344,
2033
+ "eval_samples_per_second": 63.073,
2034
+ "eval_steps_per_second": 0.662,
2035
+ "step": 698
2036
+ },
2037
+ {
2038
+ "epoch": 215.38,
2039
+ "grad_norm": 0.41818705201148987,
2040
+ "learning_rate": 1.111111111111111e-05,
2041
+ "loss": 0.632,
2042
+ "step": 700
2043
+ },
2044
+ {
2045
+ "epoch": 216.0,
2046
+ "eval_accuracy": 0.6608391608391608,
2047
+ "eval_loss": 0.939588189125061,
2048
+ "eval_runtime": 4.3905,
2049
+ "eval_samples_per_second": 65.141,
2050
+ "eval_steps_per_second": 0.683,
2051
+ "step": 702
2052
+ },
2053
+ {
2054
+ "epoch": 216.92,
2055
+ "eval_accuracy": 0.6608391608391608,
2056
+ "eval_loss": 0.9378303289413452,
2057
+ "eval_runtime": 3.949,
2058
+ "eval_samples_per_second": 72.423,
2059
+ "eval_steps_per_second": 0.76,
2060
+ "step": 705
2061
+ },
2062
+ {
2063
+ "epoch": 217.85,
2064
+ "eval_accuracy": 0.6608391608391608,
2065
+ "eval_loss": 0.9359939694404602,
2066
+ "eval_runtime": 6.0391,
2067
+ "eval_samples_per_second": 47.358,
2068
+ "eval_steps_per_second": 0.497,
2069
+ "step": 708
2070
+ },
2071
+ {
2072
+ "epoch": 218.77,
2073
+ "eval_accuracy": 0.6608391608391608,
2074
+ "eval_loss": 0.9351831078529358,
2075
+ "eval_runtime": 3.9064,
2076
+ "eval_samples_per_second": 73.213,
2077
+ "eval_steps_per_second": 0.768,
2078
+ "step": 711
2079
+ },
2080
+ {
2081
+ "epoch": 220.0,
2082
+ "eval_accuracy": 0.6678321678321678,
2083
+ "eval_loss": 0.9344322085380554,
2084
+ "eval_runtime": 4.2696,
2085
+ "eval_samples_per_second": 66.986,
2086
+ "eval_steps_per_second": 0.703,
2087
+ "step": 715
2088
+ },
2089
+ {
2090
+ "epoch": 220.92,
2091
+ "eval_accuracy": 0.6678321678321678,
2092
+ "eval_loss": 0.9372223615646362,
2093
+ "eval_runtime": 4.3125,
2094
+ "eval_samples_per_second": 66.319,
2095
+ "eval_steps_per_second": 0.696,
2096
+ "step": 718
2097
+ },
2098
+ {
2099
+ "epoch": 221.85,
2100
+ "eval_accuracy": 0.6643356643356644,
2101
+ "eval_loss": 0.9403982162475586,
2102
+ "eval_runtime": 5.843,
2103
+ "eval_samples_per_second": 48.948,
2104
+ "eval_steps_per_second": 0.513,
2105
+ "step": 721
2106
+ },
2107
+ {
2108
+ "epoch": 222.77,
2109
+ "eval_accuracy": 0.6643356643356644,
2110
+ "eval_loss": 0.9428540468215942,
2111
+ "eval_runtime": 4.6219,
2112
+ "eval_samples_per_second": 61.879,
2113
+ "eval_steps_per_second": 0.649,
2114
+ "step": 724
2115
+ },
2116
+ {
2117
+ "epoch": 224.0,
2118
+ "eval_accuracy": 0.6643356643356644,
2119
+ "eval_loss": 0.9426971673965454,
2120
+ "eval_runtime": 4.3056,
2121
+ "eval_samples_per_second": 66.425,
2122
+ "eval_steps_per_second": 0.697,
2123
+ "step": 728
2124
+ },
2125
+ {
2126
+ "epoch": 224.92,
2127
+ "eval_accuracy": 0.6643356643356644,
2128
+ "eval_loss": 0.9425584673881531,
2129
+ "eval_runtime": 4.1148,
2130
+ "eval_samples_per_second": 69.506,
2131
+ "eval_steps_per_second": 0.729,
2132
+ "step": 731
2133
+ },
2134
+ {
2135
+ "epoch": 225.85,
2136
+ "eval_accuracy": 0.6678321678321678,
2137
+ "eval_loss": 0.9411899447441101,
2138
+ "eval_runtime": 5.1345,
2139
+ "eval_samples_per_second": 55.702,
2140
+ "eval_steps_per_second": 0.584,
2141
+ "step": 734
2142
+ },
2143
+ {
2144
+ "epoch": 226.77,
2145
+ "eval_accuracy": 0.6678321678321678,
2146
+ "eval_loss": 0.9402187466621399,
2147
+ "eval_runtime": 4.509,
2148
+ "eval_samples_per_second": 63.428,
2149
+ "eval_steps_per_second": 0.665,
2150
+ "step": 737
2151
+ },
2152
+ {
2153
+ "epoch": 228.0,
2154
+ "eval_accuracy": 0.6678321678321678,
2155
+ "eval_loss": 0.9380680918693542,
2156
+ "eval_runtime": 4.4438,
2157
+ "eval_samples_per_second": 64.359,
2158
+ "eval_steps_per_second": 0.675,
2159
+ "step": 741
2160
+ },
2161
+ {
2162
+ "epoch": 228.92,
2163
+ "eval_accuracy": 0.6678321678321678,
2164
+ "eval_loss": 0.9378944635391235,
2165
+ "eval_runtime": 4.7137,
2166
+ "eval_samples_per_second": 60.674,
2167
+ "eval_steps_per_second": 0.636,
2168
+ "step": 744
2169
+ },
2170
+ {
2171
+ "epoch": 229.85,
2172
+ "eval_accuracy": 0.6678321678321678,
2173
+ "eval_loss": 0.9393661618232727,
2174
+ "eval_runtime": 4.3516,
2175
+ "eval_samples_per_second": 65.723,
2176
+ "eval_steps_per_second": 0.689,
2177
+ "step": 747
2178
+ },
2179
+ {
2180
+ "epoch": 230.77,
2181
+ "grad_norm": 0.43979376554489136,
2182
+ "learning_rate": 9.523809523809523e-06,
2183
+ "loss": 0.6285,
2184
+ "step": 750
2185
+ },
2186
+ {
2187
+ "epoch": 230.77,
2188
+ "eval_accuracy": 0.6678321678321678,
2189
+ "eval_loss": 0.9395984411239624,
2190
+ "eval_runtime": 4.7533,
2191
+ "eval_samples_per_second": 60.169,
2192
+ "eval_steps_per_second": 0.631,
2193
+ "step": 750
2194
+ },
2195
+ {
2196
+ "epoch": 232.0,
2197
+ "eval_accuracy": 0.6643356643356644,
2198
+ "eval_loss": 0.943848729133606,
2199
+ "eval_runtime": 4.0413,
2200
+ "eval_samples_per_second": 70.769,
2201
+ "eval_steps_per_second": 0.742,
2202
+ "step": 754
2203
+ },
2204
+ {
2205
+ "epoch": 232.92,
2206
+ "eval_accuracy": 0.6643356643356644,
2207
+ "eval_loss": 0.9464450478553772,
2208
+ "eval_runtime": 4.5457,
2209
+ "eval_samples_per_second": 62.916,
2210
+ "eval_steps_per_second": 0.66,
2211
+ "step": 757
2212
+ },
2213
+ {
2214
+ "epoch": 233.85,
2215
+ "eval_accuracy": 0.6643356643356644,
2216
+ "eval_loss": 0.9500763416290283,
2217
+ "eval_runtime": 4.0761,
2218
+ "eval_samples_per_second": 70.166,
2219
+ "eval_steps_per_second": 0.736,
2220
+ "step": 760
2221
+ },
2222
+ {
2223
+ "epoch": 234.77,
2224
+ "eval_accuracy": 0.6678321678321678,
2225
+ "eval_loss": 0.9517615437507629,
2226
+ "eval_runtime": 4.7434,
2227
+ "eval_samples_per_second": 60.295,
2228
+ "eval_steps_per_second": 0.632,
2229
+ "step": 763
2230
+ },
2231
+ {
2232
+ "epoch": 236.0,
2233
+ "eval_accuracy": 0.6678321678321678,
2234
+ "eval_loss": 0.9502771496772766,
2235
+ "eval_runtime": 4.4044,
2236
+ "eval_samples_per_second": 64.935,
2237
+ "eval_steps_per_second": 0.681,
2238
+ "step": 767
2239
+ },
2240
+ {
2241
+ "epoch": 236.92,
2242
+ "eval_accuracy": 0.6643356643356644,
2243
+ "eval_loss": 0.9494647979736328,
2244
+ "eval_runtime": 4.5179,
2245
+ "eval_samples_per_second": 63.304,
2246
+ "eval_steps_per_second": 0.664,
2247
+ "step": 770
2248
+ },
2249
+ {
2250
+ "epoch": 237.85,
2251
+ "eval_accuracy": 0.6643356643356644,
2252
+ "eval_loss": 0.9487398862838745,
2253
+ "eval_runtime": 5.4124,
2254
+ "eval_samples_per_second": 52.842,
2255
+ "eval_steps_per_second": 0.554,
2256
+ "step": 773
2257
+ },
2258
+ {
2259
+ "epoch": 238.77,
2260
+ "eval_accuracy": 0.6643356643356644,
2261
+ "eval_loss": 0.9492418169975281,
2262
+ "eval_runtime": 4.4487,
2263
+ "eval_samples_per_second": 64.289,
2264
+ "eval_steps_per_second": 0.674,
2265
+ "step": 776
2266
+ },
2267
+ {
2268
+ "epoch": 240.0,
2269
+ "eval_accuracy": 0.6678321678321678,
2270
+ "eval_loss": 0.9463514685630798,
2271
+ "eval_runtime": 4.2462,
2272
+ "eval_samples_per_second": 67.354,
2273
+ "eval_steps_per_second": 0.707,
2274
+ "step": 780
2275
+ },
2276
+ {
2277
+ "epoch": 240.92,
2278
+ "eval_accuracy": 0.6678321678321678,
2279
+ "eval_loss": 0.9432539343833923,
2280
+ "eval_runtime": 4.4574,
2281
+ "eval_samples_per_second": 64.163,
2282
+ "eval_steps_per_second": 0.673,
2283
+ "step": 783
2284
+ },
2285
+ {
2286
+ "epoch": 241.85,
2287
+ "eval_accuracy": 0.6643356643356644,
2288
+ "eval_loss": 0.9403123259544373,
2289
+ "eval_runtime": 4.1413,
2290
+ "eval_samples_per_second": 69.06,
2291
+ "eval_steps_per_second": 0.724,
2292
+ "step": 786
2293
+ },
2294
+ {
2295
+ "epoch": 242.77,
2296
+ "eval_accuracy": 0.6643356643356644,
2297
+ "eval_loss": 0.9371182322502136,
2298
+ "eval_runtime": 4.0874,
2299
+ "eval_samples_per_second": 69.971,
2300
+ "eval_steps_per_second": 0.734,
2301
+ "step": 789
2302
+ },
2303
+ {
2304
+ "epoch": 244.0,
2305
+ "eval_accuracy": 0.6643356643356644,
2306
+ "eval_loss": 0.9386875033378601,
2307
+ "eval_runtime": 4.427,
2308
+ "eval_samples_per_second": 64.603,
2309
+ "eval_steps_per_second": 0.678,
2310
+ "step": 793
2311
+ },
2312
+ {
2313
+ "epoch": 244.92,
2314
+ "eval_accuracy": 0.6678321678321678,
2315
+ "eval_loss": 0.9423165321350098,
2316
+ "eval_runtime": 4.5541,
2317
+ "eval_samples_per_second": 62.8,
2318
+ "eval_steps_per_second": 0.659,
2319
+ "step": 796
2320
+ },
2321
+ {
2322
+ "epoch": 245.85,
2323
+ "eval_accuracy": 0.6678321678321678,
2324
+ "eval_loss": 0.9452247619628906,
2325
+ "eval_runtime": 4.3478,
2326
+ "eval_samples_per_second": 65.78,
2327
+ "eval_steps_per_second": 0.69,
2328
+ "step": 799
2329
+ },
2330
+ {
2331
+ "epoch": 246.15,
2332
+ "grad_norm": 0.8526151776313782,
2333
+ "learning_rate": 7.936507936507936e-06,
2334
+ "loss": 0.6049,
2335
+ "step": 800
2336
+ },
2337
+ {
2338
+ "epoch": 246.77,
2339
+ "eval_accuracy": 0.6678321678321678,
2340
+ "eval_loss": 0.9474557638168335,
2341
+ "eval_runtime": 4.2324,
2342
+ "eval_samples_per_second": 67.574,
2343
+ "eval_steps_per_second": 0.709,
2344
+ "step": 802
2345
+ },
2346
+ {
2347
+ "epoch": 248.0,
2348
+ "eval_accuracy": 0.6678321678321678,
2349
+ "eval_loss": 0.9469492435455322,
2350
+ "eval_runtime": 4.2172,
2351
+ "eval_samples_per_second": 67.817,
2352
+ "eval_steps_per_second": 0.711,
2353
+ "step": 806
2354
+ },
2355
+ {
2356
+ "epoch": 248.92,
2357
+ "eval_accuracy": 0.6678321678321678,
2358
+ "eval_loss": 0.9462881088256836,
2359
+ "eval_runtime": 3.7956,
2360
+ "eval_samples_per_second": 75.351,
2361
+ "eval_steps_per_second": 0.79,
2362
+ "step": 809
2363
+ },
2364
+ {
2365
+ "epoch": 249.85,
2366
+ "eval_accuracy": 0.6678321678321678,
2367
+ "eval_loss": 0.9461723566055298,
2368
+ "eval_runtime": 4.331,
2369
+ "eval_samples_per_second": 66.036,
2370
+ "eval_steps_per_second": 0.693,
2371
+ "step": 812
2372
+ },
2373
+ {
2374
+ "epoch": 250.77,
2375
+ "eval_accuracy": 0.6678321678321678,
2376
+ "eval_loss": 0.945976972579956,
2377
+ "eval_runtime": 5.0364,
2378
+ "eval_samples_per_second": 56.787,
2379
+ "eval_steps_per_second": 0.596,
2380
+ "step": 815
2381
+ },
2382
+ {
2383
+ "epoch": 252.0,
2384
+ "eval_accuracy": 0.6678321678321678,
2385
+ "eval_loss": 0.9463274478912354,
2386
+ "eval_runtime": 4.1886,
2387
+ "eval_samples_per_second": 68.28,
2388
+ "eval_steps_per_second": 0.716,
2389
+ "step": 819
2390
+ },
2391
+ {
2392
+ "epoch": 252.92,
2393
+ "eval_accuracy": 0.6678321678321678,
2394
+ "eval_loss": 0.9467651844024658,
2395
+ "eval_runtime": 4.3006,
2396
+ "eval_samples_per_second": 66.502,
2397
+ "eval_steps_per_second": 0.698,
2398
+ "step": 822
2399
+ },
2400
+ {
2401
+ "epoch": 253.85,
2402
+ "eval_accuracy": 0.6678321678321678,
2403
+ "eval_loss": 0.9466995596885681,
2404
+ "eval_runtime": 4.7073,
2405
+ "eval_samples_per_second": 60.757,
2406
+ "eval_steps_per_second": 0.637,
2407
+ "step": 825
2408
+ },
2409
+ {
2410
+ "epoch": 254.77,
2411
+ "eval_accuracy": 0.6678321678321678,
2412
+ "eval_loss": 0.9466331005096436,
2413
+ "eval_runtime": 4.2578,
2414
+ "eval_samples_per_second": 67.171,
2415
+ "eval_steps_per_second": 0.705,
2416
+ "step": 828
2417
+ },
2418
+ {
2419
+ "epoch": 256.0,
2420
+ "eval_accuracy": 0.6678321678321678,
2421
+ "eval_loss": 0.9450873732566833,
2422
+ "eval_runtime": 4.0297,
2423
+ "eval_samples_per_second": 70.973,
2424
+ "eval_steps_per_second": 0.744,
2425
+ "step": 832
2426
+ },
2427
+ {
2428
+ "epoch": 256.92,
2429
+ "eval_accuracy": 0.6678321678321678,
2430
+ "eval_loss": 0.9441204071044922,
2431
+ "eval_runtime": 4.3682,
2432
+ "eval_samples_per_second": 65.474,
2433
+ "eval_steps_per_second": 0.687,
2434
+ "step": 835
2435
+ },
2436
+ {
2437
+ "epoch": 257.85,
2438
+ "eval_accuracy": 0.6678321678321678,
2439
+ "eval_loss": 0.9426379203796387,
2440
+ "eval_runtime": 4.5099,
2441
+ "eval_samples_per_second": 63.417,
2442
+ "eval_steps_per_second": 0.665,
2443
+ "step": 838
2444
+ },
2445
+ {
2446
+ "epoch": 258.77,
2447
+ "eval_accuracy": 0.6678321678321678,
2448
+ "eval_loss": 0.9439011216163635,
2449
+ "eval_runtime": 4.1513,
2450
+ "eval_samples_per_second": 68.894,
2451
+ "eval_steps_per_second": 0.723,
2452
+ "step": 841
2453
+ },
2454
+ {
2455
+ "epoch": 260.0,
2456
+ "eval_accuracy": 0.6678321678321678,
2457
+ "eval_loss": 0.9443875551223755,
2458
+ "eval_runtime": 4.5454,
2459
+ "eval_samples_per_second": 62.921,
2460
+ "eval_steps_per_second": 0.66,
2461
+ "step": 845
2462
+ },
2463
+ {
2464
+ "epoch": 260.92,
2465
+ "eval_accuracy": 0.6678321678321678,
2466
+ "eval_loss": 0.9435145258903503,
2467
+ "eval_runtime": 4.6513,
2468
+ "eval_samples_per_second": 61.489,
2469
+ "eval_steps_per_second": 0.645,
2470
+ "step": 848
2471
+ },
2472
+ {
2473
+ "epoch": 261.54,
2474
+ "grad_norm": 0.46575862169265747,
2475
+ "learning_rate": 6.349206349206349e-06,
2476
+ "loss": 0.6024,
2477
+ "step": 850
2478
+ },
2479
+ {
2480
+ "epoch": 261.85,
2481
+ "eval_accuracy": 0.6678321678321678,
2482
+ "eval_loss": 0.9441516399383545,
2483
+ "eval_runtime": 4.3022,
2484
+ "eval_samples_per_second": 66.478,
2485
+ "eval_steps_per_second": 0.697,
2486
+ "step": 851
2487
+ },
2488
+ {
2489
+ "epoch": 262.77,
2490
+ "eval_accuracy": 0.6678321678321678,
2491
+ "eval_loss": 0.9440596699714661,
2492
+ "eval_runtime": 4.2068,
2493
+ "eval_samples_per_second": 67.986,
2494
+ "eval_steps_per_second": 0.713,
2495
+ "step": 854
2496
+ },
2497
+ {
2498
+ "epoch": 264.0,
2499
+ "eval_accuracy": 0.6713286713286714,
2500
+ "eval_loss": 0.9449206590652466,
2501
+ "eval_runtime": 3.6546,
2502
+ "eval_samples_per_second": 78.258,
2503
+ "eval_steps_per_second": 0.821,
2504
+ "step": 858
2505
+ },
2506
+ {
2507
+ "epoch": 264.92,
2508
+ "eval_accuracy": 0.6713286713286714,
2509
+ "eval_loss": 0.9438286423683167,
2510
+ "eval_runtime": 4.4082,
2511
+ "eval_samples_per_second": 64.879,
2512
+ "eval_steps_per_second": 0.681,
2513
+ "step": 861
2514
+ },
2515
+ {
2516
+ "epoch": 265.85,
2517
+ "eval_accuracy": 0.6713286713286714,
2518
+ "eval_loss": 0.9423307180404663,
2519
+ "eval_runtime": 5.0619,
2520
+ "eval_samples_per_second": 56.5,
2521
+ "eval_steps_per_second": 0.593,
2522
+ "step": 864
2523
+ },
2524
+ {
2525
+ "epoch": 266.77,
2526
+ "eval_accuracy": 0.6678321678321678,
2527
+ "eval_loss": 0.9406384229660034,
2528
+ "eval_runtime": 3.9231,
2529
+ "eval_samples_per_second": 72.902,
2530
+ "eval_steps_per_second": 0.765,
2531
+ "step": 867
2532
+ },
2533
+ {
2534
+ "epoch": 268.0,
2535
+ "eval_accuracy": 0.6678321678321678,
2536
+ "eval_loss": 0.9399996399879456,
2537
+ "eval_runtime": 4.3437,
2538
+ "eval_samples_per_second": 65.843,
2539
+ "eval_steps_per_second": 0.691,
2540
+ "step": 871
2541
+ },
2542
+ {
2543
+ "epoch": 268.92,
2544
+ "eval_accuracy": 0.6678321678321678,
2545
+ "eval_loss": 0.9407250285148621,
2546
+ "eval_runtime": 4.1958,
2547
+ "eval_samples_per_second": 68.163,
2548
+ "eval_steps_per_second": 0.715,
2549
+ "step": 874
2550
+ },
2551
+ {
2552
+ "epoch": 269.85,
2553
+ "eval_accuracy": 0.6713286713286714,
2554
+ "eval_loss": 0.9427564740180969,
2555
+ "eval_runtime": 4.1649,
2556
+ "eval_samples_per_second": 68.668,
2557
+ "eval_steps_per_second": 0.72,
2558
+ "step": 877
2559
+ },
2560
+ {
2561
+ "epoch": 270.77,
2562
+ "eval_accuracy": 0.6713286713286714,
2563
+ "eval_loss": 0.9453551769256592,
2564
+ "eval_runtime": 4.1929,
2565
+ "eval_samples_per_second": 68.21,
2566
+ "eval_steps_per_second": 0.715,
2567
+ "step": 880
2568
+ },
2569
+ {
2570
+ "epoch": 272.0,
2571
+ "eval_accuracy": 0.6713286713286714,
2572
+ "eval_loss": 0.9466239213943481,
2573
+ "eval_runtime": 4.787,
2574
+ "eval_samples_per_second": 59.745,
2575
+ "eval_steps_per_second": 0.627,
2576
+ "step": 884
2577
+ },
2578
+ {
2579
+ "epoch": 272.92,
2580
+ "eval_accuracy": 0.6713286713286714,
2581
+ "eval_loss": 0.9471932649612427,
2582
+ "eval_runtime": 5.1674,
2583
+ "eval_samples_per_second": 55.347,
2584
+ "eval_steps_per_second": 0.581,
2585
+ "step": 887
2586
+ },
2587
+ {
2588
+ "epoch": 273.85,
2589
+ "eval_accuracy": 0.6713286713286714,
2590
+ "eval_loss": 0.9461983442306519,
2591
+ "eval_runtime": 4.2961,
2592
+ "eval_samples_per_second": 66.572,
2593
+ "eval_steps_per_second": 0.698,
2594
+ "step": 890
2595
+ },
2596
+ {
2597
+ "epoch": 274.77,
2598
+ "eval_accuracy": 0.6713286713286714,
2599
+ "eval_loss": 0.9463549852371216,
2600
+ "eval_runtime": 4.214,
2601
+ "eval_samples_per_second": 67.869,
2602
+ "eval_steps_per_second": 0.712,
2603
+ "step": 893
2604
+ },
2605
+ {
2606
+ "epoch": 276.0,
2607
+ "eval_accuracy": 0.6678321678321678,
2608
+ "eval_loss": 0.9452849626541138,
2609
+ "eval_runtime": 4.7011,
2610
+ "eval_samples_per_second": 60.836,
2611
+ "eval_steps_per_second": 0.638,
2612
+ "step": 897
2613
+ },
2614
+ {
2615
+ "epoch": 276.92,
2616
+ "grad_norm": 0.5298266410827637,
2617
+ "learning_rate": 4.7619047619047615e-06,
2618
+ "loss": 0.5966,
2619
+ "step": 900
2620
+ },
2621
+ {
2622
+ "epoch": 276.92,
2623
+ "eval_accuracy": 0.6678321678321678,
2624
+ "eval_loss": 0.943517804145813,
2625
+ "eval_runtime": 4.7023,
2626
+ "eval_samples_per_second": 60.821,
2627
+ "eval_steps_per_second": 0.638,
2628
+ "step": 900
2629
+ },
2630
+ {
2631
+ "epoch": 277.85,
2632
+ "eval_accuracy": 0.6713286713286714,
2633
+ "eval_loss": 0.9417858123779297,
2634
+ "eval_runtime": 4.8013,
2635
+ "eval_samples_per_second": 59.568,
2636
+ "eval_steps_per_second": 0.625,
2637
+ "step": 903
2638
+ },
2639
+ {
2640
+ "epoch": 278.77,
2641
+ "eval_accuracy": 0.6678321678321678,
2642
+ "eval_loss": 0.9401264190673828,
2643
+ "eval_runtime": 4.2146,
2644
+ "eval_samples_per_second": 67.859,
2645
+ "eval_steps_per_second": 0.712,
2646
+ "step": 906
2647
+ },
2648
+ {
2649
+ "epoch": 280.0,
2650
+ "eval_accuracy": 0.6678321678321678,
2651
+ "eval_loss": 0.9374663829803467,
2652
+ "eval_runtime": 4.5877,
2653
+ "eval_samples_per_second": 62.34,
2654
+ "eval_steps_per_second": 0.654,
2655
+ "step": 910
2656
+ },
2657
+ {
2658
+ "epoch": 280.92,
2659
+ "eval_accuracy": 0.6678321678321678,
2660
+ "eval_loss": 0.9365966320037842,
2661
+ "eval_runtime": 4.7172,
2662
+ "eval_samples_per_second": 60.629,
2663
+ "eval_steps_per_second": 0.636,
2664
+ "step": 913
2665
+ },
2666
+ {
2667
+ "epoch": 281.85,
2668
+ "eval_accuracy": 0.6678321678321678,
2669
+ "eval_loss": 0.9357553720474243,
2670
+ "eval_runtime": 4.1128,
2671
+ "eval_samples_per_second": 69.539,
2672
+ "eval_steps_per_second": 0.729,
2673
+ "step": 916
2674
+ },
2675
+ {
2676
+ "epoch": 282.77,
2677
+ "eval_accuracy": 0.6678321678321678,
2678
+ "eval_loss": 0.9363517761230469,
2679
+ "eval_runtime": 4.5892,
2680
+ "eval_samples_per_second": 62.321,
2681
+ "eval_steps_per_second": 0.654,
2682
+ "step": 919
2683
+ },
2684
+ {
2685
+ "epoch": 284.0,
2686
+ "eval_accuracy": 0.6713286713286714,
2687
+ "eval_loss": 0.9368854761123657,
2688
+ "eval_runtime": 4.6233,
2689
+ "eval_samples_per_second": 61.86,
2690
+ "eval_steps_per_second": 0.649,
2691
+ "step": 923
2692
+ },
2693
+ {
2694
+ "epoch": 284.92,
2695
+ "eval_accuracy": 0.6713286713286714,
2696
+ "eval_loss": 0.9384199976921082,
2697
+ "eval_runtime": 4.5974,
2698
+ "eval_samples_per_second": 62.21,
2699
+ "eval_steps_per_second": 0.653,
2700
+ "step": 926
2701
+ },
2702
+ {
2703
+ "epoch": 285.85,
2704
+ "eval_accuracy": 0.6713286713286714,
2705
+ "eval_loss": 0.9411068558692932,
2706
+ "eval_runtime": 4.3443,
2707
+ "eval_samples_per_second": 65.834,
2708
+ "eval_steps_per_second": 0.691,
2709
+ "step": 929
2710
+ },
2711
+ {
2712
+ "epoch": 286.77,
2713
+ "eval_accuracy": 0.6713286713286714,
2714
+ "eval_loss": 0.9424038529396057,
2715
+ "eval_runtime": 4.1488,
2716
+ "eval_samples_per_second": 68.936,
2717
+ "eval_steps_per_second": 0.723,
2718
+ "step": 932
2719
+ },
2720
+ {
2721
+ "epoch": 288.0,
2722
+ "eval_accuracy": 0.6678321678321678,
2723
+ "eval_loss": 0.9443323016166687,
2724
+ "eval_runtime": 3.949,
2725
+ "eval_samples_per_second": 72.423,
2726
+ "eval_steps_per_second": 0.76,
2727
+ "step": 936
2728
+ },
2729
+ {
2730
+ "epoch": 288.92,
2731
+ "eval_accuracy": 0.6678321678321678,
2732
+ "eval_loss": 0.945092499256134,
2733
+ "eval_runtime": 5.4756,
2734
+ "eval_samples_per_second": 52.232,
2735
+ "eval_steps_per_second": 0.548,
2736
+ "step": 939
2737
+ },
2738
+ {
2739
+ "epoch": 289.85,
2740
+ "eval_accuracy": 0.6713286713286714,
2741
+ "eval_loss": 0.9460843801498413,
2742
+ "eval_runtime": 4.3265,
2743
+ "eval_samples_per_second": 66.104,
2744
+ "eval_steps_per_second": 0.693,
2745
+ "step": 942
2746
+ },
2747
+ {
2748
+ "epoch": 290.77,
2749
+ "eval_accuracy": 0.6678321678321678,
2750
+ "eval_loss": 0.9465355277061462,
2751
+ "eval_runtime": 4.0418,
2752
+ "eval_samples_per_second": 70.761,
2753
+ "eval_steps_per_second": 0.742,
2754
+ "step": 945
2755
+ },
2756
+ {
2757
+ "epoch": 292.0,
2758
+ "eval_accuracy": 0.6713286713286714,
2759
+ "eval_loss": 0.9477852582931519,
2760
+ "eval_runtime": 4.5983,
2761
+ "eval_samples_per_second": 62.196,
2762
+ "eval_steps_per_second": 0.652,
2763
+ "step": 949
2764
+ },
2765
+ {
2766
+ "epoch": 292.31,
2767
+ "grad_norm": 0.48691806197166443,
2768
+ "learning_rate": 3.1746031746031746e-06,
2769
+ "loss": 0.5841,
2770
+ "step": 950
2771
+ },
2772
+ {
2773
+ "epoch": 292.92,
2774
+ "eval_accuracy": 0.6713286713286714,
2775
+ "eval_loss": 0.9479745626449585,
2776
+ "eval_runtime": 4.8468,
2777
+ "eval_samples_per_second": 59.008,
2778
+ "eval_steps_per_second": 0.619,
2779
+ "step": 952
2780
+ },
2781
+ {
2782
+ "epoch": 293.85,
2783
+ "eval_accuracy": 0.6713286713286714,
2784
+ "eval_loss": 0.9476760029792786,
2785
+ "eval_runtime": 4.2654,
2786
+ "eval_samples_per_second": 67.051,
2787
+ "eval_steps_per_second": 0.703,
2788
+ "step": 955
2789
+ },
2790
+ {
2791
+ "epoch": 294.77,
2792
+ "eval_accuracy": 0.6713286713286714,
2793
+ "eval_loss": 0.9466102719306946,
2794
+ "eval_runtime": 5.1835,
2795
+ "eval_samples_per_second": 55.175,
2796
+ "eval_steps_per_second": 0.579,
2797
+ "step": 958
2798
+ },
2799
+ {
2800
+ "epoch": 296.0,
2801
+ "eval_accuracy": 0.6678321678321678,
2802
+ "eval_loss": 0.9453703165054321,
2803
+ "eval_runtime": 4.2033,
2804
+ "eval_samples_per_second": 68.041,
2805
+ "eval_steps_per_second": 0.714,
2806
+ "step": 962
2807
+ },
2808
+ {
2809
+ "epoch": 296.92,
2810
+ "eval_accuracy": 0.6678321678321678,
2811
+ "eval_loss": 0.9448667764663696,
2812
+ "eval_runtime": 5.1456,
2813
+ "eval_samples_per_second": 55.582,
2814
+ "eval_steps_per_second": 0.583,
2815
+ "step": 965
2816
+ },
2817
+ {
2818
+ "epoch": 297.85,
2819
+ "eval_accuracy": 0.6678321678321678,
2820
+ "eval_loss": 0.944092333316803,
2821
+ "eval_runtime": 4.8501,
2822
+ "eval_samples_per_second": 58.968,
2823
+ "eval_steps_per_second": 0.619,
2824
+ "step": 968
2825
+ },
2826
+ {
2827
+ "epoch": 298.77,
2828
+ "eval_accuracy": 0.6713286713286714,
2829
+ "eval_loss": 0.9439365267753601,
2830
+ "eval_runtime": 4.6304,
2831
+ "eval_samples_per_second": 61.765,
2832
+ "eval_steps_per_second": 0.648,
2833
+ "step": 971
2834
+ },
2835
+ {
2836
+ "epoch": 300.0,
2837
+ "eval_accuracy": 0.6713286713286714,
2838
+ "eval_loss": 0.9432730674743652,
2839
+ "eval_runtime": 4.2353,
2840
+ "eval_samples_per_second": 67.527,
2841
+ "eval_steps_per_second": 0.708,
2842
+ "step": 975
2843
+ },
2844
+ {
2845
+ "epoch": 300.92,
2846
+ "eval_accuracy": 0.6713286713286714,
2847
+ "eval_loss": 0.9432761669158936,
2848
+ "eval_runtime": 5.7923,
2849
+ "eval_samples_per_second": 49.376,
2850
+ "eval_steps_per_second": 0.518,
2851
+ "step": 978
2852
+ },
2853
+ {
2854
+ "epoch": 301.85,
2855
+ "eval_accuracy": 0.6713286713286714,
2856
+ "eval_loss": 0.9426748752593994,
2857
+ "eval_runtime": 5.2861,
2858
+ "eval_samples_per_second": 54.104,
2859
+ "eval_steps_per_second": 0.568,
2860
+ "step": 981
2861
+ },
2862
+ {
2863
+ "epoch": 302.77,
2864
+ "eval_accuracy": 0.6713286713286714,
2865
+ "eval_loss": 0.9422904253005981,
2866
+ "eval_runtime": 4.6604,
2867
+ "eval_samples_per_second": 61.368,
2868
+ "eval_steps_per_second": 0.644,
2869
+ "step": 984
2870
+ },
2871
+ {
2872
+ "epoch": 304.0,
2873
+ "eval_accuracy": 0.6713286713286714,
2874
+ "eval_loss": 0.941644012928009,
2875
+ "eval_runtime": 4.5261,
2876
+ "eval_samples_per_second": 63.19,
2877
+ "eval_steps_per_second": 0.663,
2878
+ "step": 988
2879
+ },
2880
+ {
2881
+ "epoch": 304.92,
2882
+ "eval_accuracy": 0.6713286713286714,
2883
+ "eval_loss": 0.9412463903427124,
2884
+ "eval_runtime": 3.7658,
2885
+ "eval_samples_per_second": 75.946,
2886
+ "eval_steps_per_second": 0.797,
2887
+ "step": 991
2888
+ },
2889
+ {
2890
+ "epoch": 305.85,
2891
+ "eval_accuracy": 0.6713286713286714,
2892
+ "eval_loss": 0.9411738514900208,
2893
+ "eval_runtime": 4.5896,
2894
+ "eval_samples_per_second": 62.315,
2895
+ "eval_steps_per_second": 0.654,
2896
+ "step": 994
2897
+ },
2898
+ {
2899
+ "epoch": 306.77,
2900
+ "eval_accuracy": 0.6713286713286714,
2901
+ "eval_loss": 0.9409748315811157,
2902
+ "eval_runtime": 5.0951,
2903
+ "eval_samples_per_second": 56.133,
2904
+ "eval_steps_per_second": 0.589,
2905
+ "step": 997
2906
+ },
2907
+ {
2908
+ "epoch": 307.69,
2909
+ "grad_norm": 0.4341520071029663,
2910
+ "learning_rate": 1.5873015873015873e-06,
2911
+ "loss": 0.5913,
2912
+ "step": 1000
2913
+ },
2914
+ {
2915
+ "epoch": 308.0,
2916
+ "eval_accuracy": 0.6713286713286714,
2917
+ "eval_loss": 0.9409425258636475,
2918
+ "eval_runtime": 4.2421,
2919
+ "eval_samples_per_second": 67.419,
2920
+ "eval_steps_per_second": 0.707,
2921
+ "step": 1001
2922
+ },
2923
+ {
2924
+ "epoch": 308.92,
2925
+ "eval_accuracy": 0.6713286713286714,
2926
+ "eval_loss": 0.9412462115287781,
2927
+ "eval_runtime": 5.4761,
2928
+ "eval_samples_per_second": 52.227,
2929
+ "eval_steps_per_second": 0.548,
2930
+ "step": 1004
2931
+ },
2932
+ {
2933
+ "epoch": 309.85,
2934
+ "eval_accuracy": 0.6713286713286714,
2935
+ "eval_loss": 0.9415078163146973,
2936
+ "eval_runtime": 4.3021,
2937
+ "eval_samples_per_second": 66.479,
2938
+ "eval_steps_per_second": 0.697,
2939
+ "step": 1007
2940
+ },
2941
+ {
2942
+ "epoch": 310.77,
2943
+ "eval_accuracy": 0.6713286713286714,
2944
+ "eval_loss": 0.9418912529945374,
2945
+ "eval_runtime": 4.6753,
2946
+ "eval_samples_per_second": 61.173,
2947
+ "eval_steps_per_second": 0.642,
2948
+ "step": 1010
2949
+ },
2950
+ {
2951
+ "epoch": 312.0,
2952
+ "eval_accuracy": 0.6713286713286714,
2953
+ "eval_loss": 0.9425641298294067,
2954
+ "eval_runtime": 4.2216,
2955
+ "eval_samples_per_second": 67.746,
2956
+ "eval_steps_per_second": 0.711,
2957
+ "step": 1014
2958
+ },
2959
+ {
2960
+ "epoch": 312.92,
2961
+ "eval_accuracy": 0.6678321678321678,
2962
+ "eval_loss": 0.9430021047592163,
2963
+ "eval_runtime": 4.5627,
2964
+ "eval_samples_per_second": 62.682,
2965
+ "eval_steps_per_second": 0.658,
2966
+ "step": 1017
2967
+ },
2968
+ {
2969
+ "epoch": 313.85,
2970
+ "eval_accuracy": 0.6678321678321678,
2971
+ "eval_loss": 0.9434046149253845,
2972
+ "eval_runtime": 4.4071,
2973
+ "eval_samples_per_second": 64.896,
2974
+ "eval_steps_per_second": 0.681,
2975
+ "step": 1020
2976
+ },
2977
+ {
2978
+ "epoch": 314.77,
2979
+ "eval_accuracy": 0.6678321678321678,
2980
+ "eval_loss": 0.9436425566673279,
2981
+ "eval_runtime": 4.4183,
2982
+ "eval_samples_per_second": 64.731,
2983
+ "eval_steps_per_second": 0.679,
2984
+ "step": 1023
2985
+ },
2986
+ {
2987
+ "epoch": 316.0,
2988
+ "eval_accuracy": 0.6678321678321678,
2989
+ "eval_loss": 0.9438886046409607,
2990
+ "eval_runtime": 5.0213,
2991
+ "eval_samples_per_second": 56.958,
2992
+ "eval_steps_per_second": 0.597,
2993
+ "step": 1027
2994
+ },
2995
+ {
2996
+ "epoch": 316.92,
2997
+ "eval_accuracy": 0.6678321678321678,
2998
+ "eval_loss": 0.9438981413841248,
2999
+ "eval_runtime": 4.4087,
3000
+ "eval_samples_per_second": 64.872,
3001
+ "eval_steps_per_second": 0.68,
3002
+ "step": 1030
3003
+ },
3004
+ {
3005
+ "epoch": 317.85,
3006
+ "eval_accuracy": 0.6678321678321678,
3007
+ "eval_loss": 0.9438797831535339,
3008
+ "eval_runtime": 4.2787,
3009
+ "eval_samples_per_second": 66.843,
3010
+ "eval_steps_per_second": 0.701,
3011
+ "step": 1033
3012
+ },
3013
+ {
3014
+ "epoch": 318.77,
3015
+ "eval_accuracy": 0.6678321678321678,
3016
+ "eval_loss": 0.9440018534660339,
3017
+ "eval_runtime": 4.5412,
3018
+ "eval_samples_per_second": 62.979,
3019
+ "eval_steps_per_second": 0.661,
3020
+ "step": 1036
3021
+ },
3022
+ {
3023
+ "epoch": 320.0,
3024
+ "eval_accuracy": 0.6678321678321678,
3025
+ "eval_loss": 0.9439986348152161,
3026
+ "eval_runtime": 5.0195,
3027
+ "eval_samples_per_second": 56.978,
3028
+ "eval_steps_per_second": 0.598,
3029
+ "step": 1040
3030
+ },
3031
+ {
3032
+ "epoch": 320.92,
3033
+ "eval_accuracy": 0.6678321678321678,
3034
+ "eval_loss": 0.944036602973938,
3035
+ "eval_runtime": 4.4758,
3036
+ "eval_samples_per_second": 63.899,
3037
+ "eval_steps_per_second": 0.67,
3038
+ "step": 1043
3039
+ },
3040
+ {
3041
+ "epoch": 321.85,
3042
+ "eval_accuracy": 0.6678321678321678,
3043
+ "eval_loss": 0.9441185593605042,
3044
+ "eval_runtime": 6.0328,
3045
+ "eval_samples_per_second": 47.408,
3046
+ "eval_steps_per_second": 0.497,
3047
+ "step": 1046
3048
+ },
3049
+ {
3050
+ "epoch": 322.77,
3051
+ "eval_accuracy": 0.6678321678321678,
3052
+ "eval_loss": 0.9441850781440735,
3053
+ "eval_runtime": 4.7198,
3054
+ "eval_samples_per_second": 60.596,
3055
+ "eval_steps_per_second": 0.636,
3056
+ "step": 1049
3057
+ },
3058
+ {
3059
+ "epoch": 323.08,
3060
+ "grad_norm": 0.7628626823425293,
3061
+ "learning_rate": 0.0,
3062
+ "loss": 0.5798,
3063
+ "step": 1050
3064
+ },
3065
+ {
3066
+ "epoch": 323.08,
3067
+ "eval_accuracy": 0.6678321678321678,
3068
+ "eval_loss": 0.9441931843757629,
3069
+ "eval_runtime": 4.692,
3070
+ "eval_samples_per_second": 60.955,
3071
+ "eval_steps_per_second": 0.639,
3072
+ "step": 1050
3073
+ },
3074
+ {
3075
+ "epoch": 323.08,
3076
+ "step": 1050,
3077
+ "total_flos": 4.380490432252032e+18,
3078
+ "train_loss": 0.8572167641775948,
3079
+ "train_runtime": 4856.1657,
3080
+ "train_samples_per_second": 111.57,
3081
+ "train_steps_per_second": 0.216
3082
+ }
3083
+ ],
3084
+ "logging_steps": 50,
3085
+ "max_steps": 1050,
3086
+ "num_input_tokens_seen": 0,
3087
+ "num_train_epochs": 350,
3088
+ "save_steps": 500,
3089
+ "total_flos": 4.380490432252032e+18,
3090
+ "train_batch_size": 128,
3091
+ "trial_name": null,
3092
+ "trial_params": null
3093
+ }