File size: 3,068 Bytes
c3f7009
f93a6f0
 
 
c1f0e2b
bab941a
c1f0e2b
bab941a
 
 
 
c1f0e2b
 
bab941a
 
c1f0e2b
bab941a
 
c1f0e2b
 
 
 
 
 
 
 
 
 
 
 
 
 
bab941a
c1f0e2b
 
 
c3f7009
 
f93a6f0
c3f7009
f93a6f0
 
bab941a
 
c1f0e2b
f93a6f0
bab941a
 
f93a6f0
bab941a
 
c1f0e2b
 
 
 
 
 
 
c3f7009
f93a6f0
c3f7009
f93a6f0
 
bab941a
 
c3f7009
f93a6f0
c3f7009
6015dc2
c3f7009
f93a6f0
c3f7009
f93a6f0
 
 
 
 
6015dc2
f93a6f0
 
 
 
 
 
 
6015dc2
c3f7009
f93a6f0
c3f7009
 
 
 
 
 
f93a6f0
 
 
6015dc2
b754d31
e1a149f
0ac15d6
aecf2b6
5b32e72
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-17T20:57:10'
  project_name: ft_bs16_lr6_base_emissions_tracker
  run_id: 65393a69-4256-4ee8-82d8-c5611a3f5b31
  duration: 39922.8010020256
  emissions: 0.0245496594537213
  emissions_rate: 6.149282825239585e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 4.500000000000001
  cpu_energy: 0.4713100399212706
  gpu_energy: 0
  ram_energy: 0.0499030862060189
  energy_consumed: 0.5212131261272877
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 2
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 12
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 39922.8010020256  |
| Emissions (Co2eq in kg)  | 0.0245496594537213 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 4.500000000000001  |
| CPU energy (kWh)         | 0.4713100399212706  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.0499030862060189  |
| Consumed energy (kWh)    | 0.5212131261272877  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 2  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.07685139192889928  |
| Emissions (Co2eq in kg)  | 0.015636430392460023 |

## Note

17 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | ft_bs16_lr6_base |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 5e-06  |
| batch_size               | 16  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 32580 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.454731 | 0.365926 | 0.840943 | 0.851227 |
| 1 | 0.348025 | 0.367064 | 0.843152 | 0.884969 |
| 2 | 0.303349 | 0.360609 | 0.848306 | 0.840491 |
| 3 | 0.247147 | 0.404108 | 0.834315 | 0.889571 |
| 4 | 0.176933 | 0.446045 | 0.822533 | 0.860429 |
| 5 | 0.126679 | 0.511276 | 0.818851 | 0.815951 |