File size: 3,033 Bytes
edfe026
67b9e30
 
 
0d9695c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
edfe026
 
67b9e30
edfe026
67b9e30
 
0d9695c
 
 
67b9e30
0d9695c
 
67b9e30
0d9695c
 
 
 
 
 
 
 
 
edfe026
67b9e30
edfe026
67b9e30
 
0d9695c
 
edfe026
67b9e30
edfe026
67b9e30
edfe026
67b9e30
edfe026
67b9e30
 
 
 
 
 
 
 
 
 
 
 
 
13a72c2
edfe026
67b9e30
edfe026
 
 
 
 
 
67b9e30
 
 
93c2147
67aea1e
4e663af
d45bea3
f005656
620fe12
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-22T18:59:41'
  project_name: ft_32_2e6_base_emissions_tracker
  run_id: 694bc11f-d030-4abe-92ab-89c8e32efac1
  duration: 94566.8026907444
  emissions: 0.0572237513240666
  emissions_rate: 6.051145824523826e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 3.75
  cpu_energy: 1.1164102884280973
  gpu_energy: 0
  ram_energy: 0.09850555888017
  energy_consumed: 1.2149158473082664
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 2
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 10
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 94566.8026907444  |
| Emissions (Co2eq in kg)  | 0.0572237513240666 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 3.75  |
| CPU energy (kWh)         | 1.1164102884280973  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.09850555888017  |
| Consumed energy (kWh)    | 1.2149158473082664  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 2  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.18204109517968298  |
| Emissions (Co2eq in kg)  | 0.03703866438720822 |

## Note

21 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | ft_32_2e6_base |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 2e-06  |
| batch_size               | 32  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 32586 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.566979 | 0.493775 | 0.769300 | 0.826475 |
| 1 | 0.433719 | 0.412018 | 0.817031 | 0.850808 |
| 2 | 0.357331 | 0.387126 | 0.825282 | 0.869627 |
| 3 | 0.293457 | 0.401614 | 0.822777 | 0.850921 |
| 4 | 0.237306 | 0.430223 | 0.810255 | 0.821977 |
| 5 | 0.185810 | 0.469887 | 0.799501 | 0.834173 |