File size: 3,106 Bytes
21ef87f 89ee645 564f90a 21ef87f 89ee645 21ef87f 89ee645 564f90a 89ee645 564f90a 89ee645 564f90a 21ef87f 89ee645 21ef87f 89ee645 564f90a 21ef87f 89ee645 21ef87f 89ee645 21ef87f 89ee645 21ef87f 89ee645 cec2f1c 21ef87f 89ee645 21ef87f 89ee645 cec2f1c e6c2c32 53b804d 4441a98 b776021 b53b4a6 7fcc82c 3fd635a 50690c6 0e07847 3590abd 93c75d2 3069196 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-10T04:12:52'
project_name: fp_bs8_lr1e4_x8_emissions_tracker
run_id: 7cbf1766-cc3f-448f-92d9-43063f93032c
duration: 189199.7375972271
emissions: 0.142335761664038
emissions_rate: 7.523042234183529e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.233602746842287
gpu_energy: 0
ram_energy: 0.7883237868626974
energy_consumed: 3.0219265337049763
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 189199.7375972271 |
| Emissions (Co2eq in kg) | 0.142335761664038 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.233602746842287 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7883237868626974 |
| Consumed energy (kWh) | 3.0219265337049763 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.36420949487466214 |
| Emissions (Co2eq in kg) | 0.07410323055891394 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr1e4_x8 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0001 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 81689 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.831572 | 15.107053 |
| 0.5 | 4.180298 | 3.747577 |
| 1.0 | 3.563155 | 3.459220 |
| 1.5 | 3.335922 | 3.296716 |
| 2.0 | 3.380067 | 6.984087 |
| 2.5 | 6.973961 | 6.969550 |
| 3.0 | 6.971643 | 6.979950 |
| 3.5 | 6.971316 | 6.981630 |
| 4.0 | 6.979162 | 6.988373 |
| 4.5 | 6.982184 | 6.984194 |
| 5.0 | 6.977189 | 6.987575 |
| 5.5 | 6.979103 | 6.984643 |
| 6.0 | 6.976059 | 6.986024 |
|