File size: 3,239 Bytes
d55bc58
6e02545
 
 
3b1e625
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d55bc58
 
6e02545
d55bc58
6e02545
 
3b1e625
 
 
6e02545
3b1e625
 
6e02545
3b1e625
 
 
 
 
 
 
 
 
d55bc58
6e02545
d55bc58
6e02545
 
3b1e625
 
d55bc58
6e02545
d55bc58
6e02545
d55bc58
6e02545
d55bc58
6e02545
 
 
 
 
 
 
 
 
 
 
 
 
 
d55bc58
6e02545
d55bc58
 
 
 
 
 
6e02545
 
 
 
ee08ce6
680ea57
2d515af
8a4a0c4
8e9bd1f
bbe7057
94eb53a
1cdd22d
ff1ef79
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-16T20:38:19'
  project_name: ft_bs64_lr7_base_emissions_tracker
  run_id: bea8cf00-389c-4ff2-b2aa-78904c18e5b1
  duration: 15632.51683139801
  emissions: 0.0102264592683038
  emissions_rate: 6.541786827162661e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 7.5
  cpu_energy: 0.18455020764586
  gpu_energy: 0
  ram_energy: 0.0325674600958824
  energy_consumed: 0.2171176677417424
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 3
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 20
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 15632.51683139801  |
| Emissions (Co2eq in kg)  | 0.0102264592683038 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 7.5  |
| CPU energy (kWh)         | 0.18455020764586  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.0325674600958824  |
| Consumed energy (kWh)    | 0.2171176677417424  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 3  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.030092594900441166  |
| Emissions (Co2eq in kg)  | 0.00612273575896422 |

## Note

16 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | ft_bs64_lr7_base |
| sequence_length          | 400  |
| num_epoch                | 10  |
| learning_rate            | 5e-07  |
| batch_size               | 64  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 54300 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.632340 | 0.605113 | 0.685567 | 0.815951 |
| 1 | 0.586177 | 0.575657 | 0.709867 | 0.831288 |
| 2 | 0.546068 | 0.549037 | 0.737850 | 0.803681 |
| 3 | 0.509133 | 0.523782 | 0.750368 | 0.774540 |
| 4 | 0.474285 | 0.502116 | 0.763623 | 0.773006 |
| 5 | 0.440148 | 0.482997 | 0.782769 | 0.808282 |
| 6 | 0.411904 | 0.476160 | 0.771723 | 0.748466 |
| 7 | 0.377375 | 0.467880 | 0.787923 | 0.831288 |
| 8 | 0.345489 | 0.474640 | 0.776878 | 0.838957 |
| 9 | 0.314638 | 0.477554 | 0.773932 | 0.809816 |