File size: 3,102 Bytes
b4d57bb f8d53cd 33890fb b4d57bb f8d53cd b4d57bb f8d53cd 33890fb f8d53cd 33890fb f8d53cd 33890fb b4d57bb f8d53cd b4d57bb f8d53cd 33890fb b4d57bb f8d53cd b4d57bb f8d53cd b4d57bb f8d53cd b4d57bb f8d53cd b4d57bb f8d53cd b4d57bb f8d53cd 35733bd 3c5928d 6f5ef6f 0d3d5e7 bbdc84e d32df37 9945eaf b6702f8 57c3cdc ed0096b 655abff 418f36c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-06-27T13:12:12'
project_name: fp_bs8_lr5_x8_emissions_tracker
run_id: c3735070-9b88-4cc8-a4b6-56bcbf5c0e8a
duration: 181388.89907860756
emissions: 0.1364597054582643
emissions_rate: 7.523046126385469e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.1413922899060753
gpu_energy: 0
ram_energy: 0.7557798605422154
energy_consumed: 2.897172150448278
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 181388.89907860756 |
| Emissions (Co2eq in kg) | 0.1364597054582643 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.1413922899060753 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7557798605422154 |
| Consumed energy (kWh) | 2.897172150448278 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3491736307263195 |
| Emissions (Co2eq in kg) | 0.07104398547245462 |
## Note
24 juin 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr5_x8 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 81877 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.261697 | 12.472152 |
| 0.5 | 4.039305 | 3.638777 |
| 1.0 | 3.482988 | 3.391594 |
| 1.5 | 3.280960 | 3.229638 |
| 2.0 | 3.146858 | 3.132874 |
| 2.5 | 3.040396 | 3.052696 |
| 3.0 | 2.964159 | 2.985242 |
| 3.5 | 2.892340 | 2.924823 |
| 4.0 | 2.829392 | 2.867743 |
| 4.5 | 2.779719 | 2.821858 |
| 5.0 | 2.722818 | 2.786506 |
| 5.5 | 2.695031 | 2.755849 |
| 6.0 | 2.655259 | 2.733309 |
|