File size: 3,111 Bytes
9fe31e0 16c12d1 cca945d 9fe31e0 16c12d1 9fe31e0 16c12d1 cca945d 16c12d1 cca945d 16c12d1 cca945d 9fe31e0 16c12d1 9fe31e0 16c12d1 cca945d 9fe31e0 16c12d1 9fe31e0 16c12d1 9fe31e0 16c12d1 9fe31e0 16c12d1 9fe31e0 16c12d1 9fe31e0 16c12d1 844203a 22e5016 058c449 1a1901a 7a76867 d4f1b4e 76f2072 8b4d3fd 02ec720 6ffab04 f156536 a95c46b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-12T13:21:53'
project_name: fp_bs8_lr2e4_x8_emissions_tracker
run_id: bec0d745-5f2c-495a-b05c-de9e3e8b60fd
duration: 156437.29193282127
emissions: 0.1176885479970912
emissions_rate: 7.523049430415233e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 1.8468254952338008
gpu_energy: 0
ram_energy: 0.6518167415996413
energy_consumed: 2.4986422368334273
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 156437.29193282127 |
| Emissions (Co2eq in kg) | 0.1176885479970912 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 1.8468254952338008 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.6518167415996413 |
| Consumed energy (kWh) | 2.4986422368334273 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.30114178697068095 |
| Emissions (Co2eq in kg) | 0.06127127267368833 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr2e4_x8 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0002 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82348 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 13.384717 | 9.900207 |
| 0.5 | 7.206026 | 7.082854 |
| 1.0 | 7.064869 | 7.050515 |
| 1.5 | 7.028292 | 7.013674 |
| 2.0 | 7.006482 | 7.013616 |
| 2.5 | 6.992118 | 6.981234 |
| 3.0 | 6.969787 | 6.990838 |
| 3.5 | 6.964780 | 6.976489 |
| 4.0 | 6.972292 | 6.979837 |
| 4.5 | 6.964612 | 6.974315 |
| 5.0 | 6.968583 | 6.973455 |
| 5.5 | 6.964287 | 6.964581 |
| 6.0 | 6.958684 | 6.959856 |
|