File size: 3,100 Bytes
aa92851 cf99d0a 245631b aa92851 cf99d0a aa92851 cf99d0a 245631b cf99d0a 245631b cf99d0a 245631b aa92851 cf99d0a aa92851 cf99d0a 245631b aa92851 cf99d0a aa92851 cf99d0a aa92851 cf99d0a aa92851 cf99d0a aa92851 cf99d0a aa92851 cf99d0a 9b1c486 32fb7ef e314721 7ec4106 6551017 43c4ec9 eacab75 ee3f554 b7b5684 8b880b9 0930e2f ea91e47 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-06-27T13:54:24'
project_name: fp_bs8_lr5_x1_emissions_tracker
run_id: 062e4e21-6bf0-491a-8b74-8e2508d03ea8
duration: 183920.0138452053
emissions: 0.1383638271848055
emissions_rate: 7.523043538984197e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.171272990133206
gpu_energy: 0
ram_energy: 0.7663255148837982
energy_consumed: 2.9375985050169975
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 183920.0138452053 |
| Emissions (Co2eq in kg) | 0.1383638271848055 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.171272990133206 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7663255148837982 |
| Consumed energy (kWh) | 2.9375985050169975 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.35404602665202023 |
| Emissions (Co2eq in kg) | 0.07203533875603874 |
## Note
24 juin 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr5_x1 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82084 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 11.763234 | 3.945357 |
| 0.5 | 2.983267 | 2.874592 |
| 1.0 | 2.774097 | 2.725822 |
| 1.5 | 2.669449 | 2.647183 |
| 2.0 | 2.581893 | 2.595491 |
| 2.5 | 2.519510 | 2.516861 |
| 3.0 | 2.453677 | 2.459931 |
| 3.5 | 2.397704 | 2.425018 |
| 4.0 | 2.345280 | 2.376190 |
| 4.5 | 2.294831 | 2.335078 |
| 5.0 | 2.254881 | 2.299566 |
| 5.5 | 2.216362 | 2.266338 |
| 6.0 | 2.182926 | 2.240382 |
|