File size: 3,106 Bytes
45a0b29 5016641 315b81a 45a0b29 5016641 45a0b29 5016641 315b81a 5016641 315b81a 5016641 315b81a 45a0b29 5016641 45a0b29 5016641 315b81a 45a0b29 5016641 45a0b29 5016641 45a0b29 5016641 45a0b29 5016641 45a0b29 5016641 45a0b29 5016641 30e0146 e1fab41 f601b22 4279354 0278309 1eea728 48beece 75f7f74 e80bd55 41ea17b 560e3f8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-13T11:50:38'
project_name: fp_bs8_lr2e4_x4_emissions_tracker
run_id: dadd9a19-f003-418d-a48f-5641af0bcf81
duration: 237362.58397865295
emissions: 0.1785690373864647
emissions_rate: 7.523049100380718e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.802192151747148
gpu_energy: 0
ram_energy: 0.9890020349254236
energy_consumed: 3.791194186672571
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 237362.58397865295 |
| Emissions (Co2eq in kg) | 0.1785690373864647 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.802192151747148 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.9890020349254236 |
| Consumed energy (kWh) | 3.791194186672571 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.456922974158907 |
| Emissions (Co2eq in kg) | 0.09296701205830574 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr2e4_x4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0002 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82664 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.987936 | 11.931193 |
| 0.5 | 7.140273 | 7.057710 |
| 1.0 | 7.035364 | 7.019231 |
| 1.5 | 7.000329 | 7.007203 |
| 2.0 | 6.982339 | 6.987988 |
| 2.5 | 6.980809 | 6.980021 |
| 3.0 | 6.973144 | 6.982472 |
| 3.5 | 6.966241 | 6.977357 |
| 4.0 | 6.965905 | 6.969510 |
| 4.5 | 6.957660 | 6.966595 |
| 5.0 | 6.968893 | 6.967915 |
| 5.5 | 6.962095 | 6.962197 |
| 6.0 | 6.951328 | 6.962886 |
|