File size: 3,271 Bytes
8809f69
ef3f643
 
 
aeabeb1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8809f69
 
ef3f643
8809f69
ef3f643
 
aeabeb1
 
 
ef3f643
aeabeb1
 
ef3f643
aeabeb1
 
 
 
 
 
 
 
 
8809f69
ef3f643
8809f69
ef3f643
 
aeabeb1
 
8809f69
ef3f643
8809f69
ef3f643
8809f69
ef3f643
8809f69
ef3f643
 
 
 
 
 
 
 
 
 
 
 
 
 
8809f69
ef3f643
8809f69
 
 
 
 
 
ef3f643
 
 
 
331186f
858a596
4973682
03ad3dd
19b2325
62a73ed
93f5927
d7cafac
46776f8
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-16T22:33:13'
  project_name: ft_bs16_lr7_base_emissions_tracker
  run_id: 4a3aebd8-5753-45a3-af09-6c0aad5dece5
  duration: 22631.866507530212
  emissions: 0.0139169743825858
  emissions_rate: 6.149282640013517e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 4.500000000000001
  cpu_energy: 0.267181290489766
  gpu_energy: 0
  ram_energy: 0.0282895993551612
  energy_consumed: 0.2954708898449266
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 2
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 12
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 22631.866507530212  |
| Emissions (Co2eq in kg)  | 0.0139169743825858 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 4.500000000000001  |
| CPU energy (kWh)         | 0.267181290489766  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.0282895993551612  |
| Consumed energy (kWh)    | 0.2954708898449266  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 2  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.04356634302699566  |
| Emissions (Co2eq in kg)  | 0.008864147715449333 |

## Note

16 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | ft_bs16_lr7_base |
| sequence_length          | 400  |
| num_epoch                | 10  |
| learning_rate            | 5e-07  |
| batch_size               | 16  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 54300 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.629086 | 0.590556 | 0.692194 | 0.911043 |
| 1 | 0.548482 | 0.540004 | 0.726068 | 0.872699 |
| 2 | 0.501704 | 0.512447 | 0.754786 | 0.886503 |
| 3 | 0.459357 | 0.494099 | 0.770250 | 0.857362 |
| 4 | 0.416389 | 0.479099 | 0.789396 | 0.869632 |
| 5 | 0.380655 | 0.477198 | 0.782032 | 0.888037 |
| 6 | 0.344400 | 0.471280 | 0.786451 | 0.880368 |
| 7 | 0.310361 | 0.469706 | 0.785714 | 0.869632 |
| 8 | 0.280115 | 0.481110 | 0.781296 | 0.869632 |
| 9 | 0.250575 | 0.481127 | 0.770987 | 0.817485 |