File size: 3,106 Bytes
35b1274 39eab76 ea12168 35b1274 39eab76 35b1274 39eab76 ea12168 39eab76 ea12168 39eab76 ea12168 35b1274 39eab76 35b1274 39eab76 ea12168 35b1274 39eab76 35b1274 39eab76 35b1274 39eab76 35b1274 39eab76 35b1274 39eab76 35b1274 39eab76 88fb07c dcfcc17 38406f4 16fe54c 9e6f2e5 aa8d661 3125a64 5e41916 5219557 8ff32ea 9bfd7b0 87ec93b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-06-27T04:15:45'
project_name: fp_bs8_lr5_x12_emissions_tracker
run_id: 383ad829-cfe9-4004-8edb-256c917b8191
duration: 149202.29011011124
emissions: 0.1122456412119565
emissions_rate: 7.523050827780143e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 1.7614126276703366
gpu_energy: 0
ram_energy: 0.6216714090158515
energy_consumed: 2.3830840366861965
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 149202.29011011124 |
| Emissions (Co2eq in kg) | 0.1122456412119565 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 1.7614126276703366 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.6216714090158515 |
| Consumed energy (kWh) | 2.3830840366861965 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.2872144084619641 |
| Emissions (Co2eq in kg) | 0.05843756362646023 |
## Note
24 juin 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr5_x12 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82829 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 12.793059 | 10.997055 |
| 0.5 | 4.387009 | 3.999417 |
| 1.0 | 3.826829 | 3.703264 |
| 1.5 | 3.604381 | 3.563780 |
| 2.0 | 3.450672 | 3.413914 |
| 2.5 | 3.329538 | 3.332963 |
| 3.0 | 3.239998 | 3.237234 |
| 3.5 | 3.156515 | 3.187907 |
| 4.0 | 3.088817 | 3.110496 |
| 4.5 | 3.007377 | 3.059386 |
| 5.0 | 2.959972 | 3.014899 |
| 5.5 | 2.906245 | 2.975704 |
| 6.0 | 2.884630 | 2.952865 |
|