File size: 3,108 Bytes
55b1e6c 3a5d5a8 c372afd 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 c372afd 3a5d5a8 c372afd 3a5d5a8 c372afd 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 c372afd 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 55b1e6c 3a5d5a8 190372f 3835ab8 15f7c61 06770f7 eb7ff6d 8c7c441 e4f5ca1 cc53524 c792fda 15e8e38 9658128 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-12T16:24:18'
project_name: fp_bs8_lr2e4_x1_emissions_tracker
run_id: 230c823a-1f8d-42d3-a62f-a7d994bb11e9
duration: 167382.26985740662
emissions: 0.1259225240625805
emissions_rate: 7.523050330829799e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 1.9760370576446304
gpu_energy: 0
ram_energy: 0.6974204923560247
energy_consumed: 2.673457550000649
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 167382.26985740662 |
| Emissions (Co2eq in kg) | 0.1259225240625805 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 1.9760370576446304 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.6974204923560247 |
| Consumed energy (kWh) | 2.673457550000649 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3222108694755077 |
| Emissions (Co2eq in kg) | 0.06555805569415092 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr2e4_x1 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0002 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 81942 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 12.284565 | 4.237921 |
| 0.5 | 6.362647 | 7.038049 |
| 1.0 | 7.013648 | 7.018353 |
| 1.5 | 7.002928 | 7.004612 |
| 2.0 | 6.990743 | 6.986365 |
| 2.5 | 6.975980 | 6.980936 |
| 3.0 | 6.977944 | 6.977182 |
| 3.5 | 6.961034 | 6.974250 |
| 4.0 | 6.958879 | 6.971758 |
| 4.5 | 6.957661 | 6.962825 |
| 5.0 | 6.963588 | 6.961454 |
| 5.5 | 6.952163 | 6.955734 |
| 6.0 | 6.943128 | 6.949183 |
|