File size: 3,108 Bytes
c1eb792 d835cdd 4159f5b c1eb792 d835cdd c1eb792 d835cdd 4159f5b d835cdd 4159f5b d835cdd 4159f5b c1eb792 d835cdd c1eb792 d835cdd 4159f5b c1eb792 d835cdd c1eb792 d835cdd c1eb792 d835cdd c1eb792 d835cdd 9a31b0a c1eb792 d835cdd c1eb792 d835cdd 9a31b0a df6736a fae5d71 ea17f8f 1ae9181 91703f8 7bbddeb f164cbb cac9991 3cfc15a 37d6b87 9227fa4 4eb75f1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-10T05:29:06'
project_name: fp_bs8_lr1e4_x12_emissions_tracker
run_id: 0e9ef92c-5251-4d93-b87e-85577e81653f
duration: 193774.03107452393
emissions: 0.1457770353129079
emissions_rate: 7.523042922962328e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.287604636890362
gpu_energy: 0
ram_energy: 0.807383480408787
energy_consumed: 3.094988117299165
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 193774.03107452393 |
| Emissions (Co2eq in kg) | 0.1457770353129079 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.287604636890362 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.807383480408787 |
| Consumed energy (kWh) | 3.094988117299165 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.37301500981845853 |
| Emissions (Co2eq in kg) | 0.07589482883752185 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr1e4_x12 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0001 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82504 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.649603 | 12.209612 |
| 0.5 | 4.477407 | 4.065550 |
| 1.0 | 3.866738 | 3.750833 |
| 1.5 | 3.629347 | 3.564565 |
| 2.0 | 3.463593 | 3.459268 |
| 2.5 | 3.341390 | 3.334680 |
| 3.0 | 3.226287 | 3.253795 |
| 3.5 | 3.123413 | 3.157251 |
| 4.0 | 3.035034 | 3.075900 |
| 4.5 | 2.954775 | 3.017399 |
| 5.0 | 2.881607 | 2.949030 |
| 5.5 | 2.822169 | 2.896001 |
| 6.0 | 2.768646 | 2.867339 |
|