File size: 3,040 Bytes
690a93b
4c690ab
 
 
dd0a7b1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
690a93b
 
4c690ab
690a93b
4c690ab
 
dd0a7b1
 
 
4c690ab
dd0a7b1
 
4c690ab
dd0a7b1
 
 
 
 
 
 
 
 
690a93b
4c690ab
690a93b
4c690ab
 
dd0a7b1
 
690a93b
4c690ab
690a93b
4c690ab
690a93b
4c690ab
690a93b
4c690ab
 
 
 
 
 
 
 
 
 
 
 
 
5d71619
690a93b
4c690ab
690a93b
 
 
 
 
 
4c690ab
 
 
2452bb3
1bd97e5
a7e026b
afebba7
5deda29
f86e15b
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
---
language: en
tags:
- fill-mask
kwargs:
  timestamp: '2024-05-22T12:49:26'
  project_name: ft_16_2e6_base_emissions_tracker
  run_id: 4c3a0b2f-331d-494b-9aae-7dd7f9b1a9f2
  duration: 72292.58600878716
  emissions: 0.0437453634460759
  emissions_rate: 6.051154877867931e-07
  cpu_power: 42.5
  gpu_power: 0.0
  ram_power: 3.75
  cpu_energy: 0.8534524710832389
  gpu_energy: 0
  ram_energy: 0.0753041040653985
  energy_consumed: 0.9287565751486369
  country_name: Switzerland
  country_iso_code: CHE
  region: .nan
  cloud_provider: .nan
  cloud_region: .nan
  os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
  python_version: 3.10.4
  codecarbon_version: 2.3.4
  cpu_count: 2
  cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
  gpu_count: .nan
  gpu_model: .nan
  longitude: .nan
  latitude: .nan
  ram_total_size: 10
  tracking_mode: machine
  on_cloud: N
  pue: 1.0
---

## Environmental Impact (CODE CARBON DEFAULT)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| Duration (in seconds)    | 72292.58600878716  |
| Emissions (Co2eq in kg)  | 0.0437453634460759 |
| CPU power (W)            | 42.5  |
| GPU power (W)            | [No GPU]  |
| RAM power (W)            | 3.75  |
| CPU energy (kWh)         | 0.8534524710832389  |
| GPU energy (kWh)         | [No GPU]  |
| RAM energy (kWh)         | 0.0753041040653985  |
| Consumed energy (kWh)    | 0.9287565751486369  |
| Country name             | Switzerland  |
| Cloud provider           | nan  |
| Cloud region             | nan  |
| CPU count                | 2  |
| CPU model                | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz  |
| GPU count                | nan  |
| GPU model                | nan  |

## Environmental Impact (for one core)

| Metric                   | Value                           |
|--------------------------|---------------------------------|
| CPU energy (kWh)         | 0.13916322806691525  |
| Emissions (Co2eq in kg)  | 0.028314596186774968 |

## Note

21 May 2024

## My Config

| Config                   | Value           |
|--------------------------|-----------------|
| checkpoint               | albert-base-v2  |
| model_name               | ft_16_2e6_base |
| sequence_length          | 400  |
| num_epoch                | 6  |
| learning_rate            | 2e-06  |
| batch_size               | 16  |
| weight_decay             | 0.0  |
| warm_up_prop             | 0.0  |
| drop_out_prob            | 0.1 |
| packing_length           | 100 |
| train_test_split         | 0.2 |
| num_steps                | 32586 |

## Training and Testing steps






 
Epoch | Train Loss | Test Loss | Accuracy | Recall
---|---|---|---|---
| 0 | 0.544336 | 0.477866 | 0.767240 | 0.803225 |
| 1 | 0.396334 | 0.386530 | 0.827345 | 0.877139 |
| 2 | 0.321938 | 0.380702 | 0.832649 | 0.840887 |
| 3 | 0.258635 | 0.413110 | 0.816591 | 0.838604 |
| 4 | 0.215591 | 0.433801 | 0.812760 | 0.825242 |
| 5 | 0.162357 | 0.478323 | 0.809816 | 0.807659 |