File size: 3,103 Bytes
bb50175 7ebe1d6 ad0ce0e bb50175 7ebe1d6 bb50175 7ebe1d6 ad0ce0e 7ebe1d6 ad0ce0e 7ebe1d6 ad0ce0e bb50175 7ebe1d6 bb50175 7ebe1d6 ad0ce0e bb50175 7ebe1d6 bb50175 7ebe1d6 bb50175 7ebe1d6 bb50175 7ebe1d6 bb50175 7ebe1d6 bb50175 7ebe1d6 6517e60 39c1d25 fc00141 0a8ad5b 4353bf0 07f6742 66105bd 3fd41fa 9fc5a87 f019485 10e0cee 971ccec | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-06-27T12:11:19'
project_name: fp_bs8_lr5_x4_emissions_tracker
run_id: fe02877c-eb6f-4dbb-b92c-84bd37fee987
duration: 177735.54814982414
emissions: 0.1337112984336831
emissions_rate: 7.523047574082915e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.098262737140218
gpu_energy: 0
ram_energy: 0.7405580614348248
energy_consumed: 2.8388207985750444
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 177735.54814982414 |
| Emissions (Co2eq in kg) | 0.1337112984336831 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.098262737140218 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7405580614348248 |
| Consumed energy (kWh) | 2.8388207985750444 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.34214093018841146 |
| Emissions (Co2eq in kg) | 0.06961308969201445 |
## Note
24 juin 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr5_x4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 81287 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 15.470805 | 10.927505 |
| 0.5 | 3.806336 | 3.467919 |
| 1.0 | 3.306795 | 3.229490 |
| 1.5 | 3.119937 | 3.106039 |
| 2.0 | 2.988004 | 2.978410 |
| 2.5 | 2.893831 | 2.911033 |
| 3.0 | 2.817451 | 2.824359 |
| 3.5 | 2.749720 | 2.786094 |
| 4.0 | 2.679766 | 2.726988 |
| 4.5 | 2.637161 | 2.677145 |
| 5.0 | 2.585987 | 2.642253 |
| 5.5 | 2.547930 | 2.603068 |
| 6.0 | 2.514662 | 2.587190 |
|