File size: 3,112 Bytes
f09c262 d050424 ffc9151 f09c262 d050424 f09c262 d050424 ffc9151 d050424 ffc9151 d050424 ffc9151 f09c262 d050424 f09c262 d050424 ffc9151 f09c262 d050424 f09c262 d050424 f09c262 d050424 f09c262 d050424 f09c262 d050424 f09c262 d050424 2943efe f71930d 521921b c08950f b095cca cf3f9d5 88b1440 05961af a52c2a3 d64a9d5 f472b28 e91eaf3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-12T13:49:57'
project_name: fp_bs8_lr2e4_x12_emissions_tracker
run_id: 04a6d155-b8b6-415b-8915-926660ee461c
duration: 158122.01739954948
emissions: 0.1189560180550848
emissions_rate: 7.523052134763857e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 1.8667151043721375
gpu_energy: 0
ram_energy: 0.6588367534458606
energy_consumed: 2.525551857817984
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 158122.01739954948 |
| Emissions (Co2eq in kg) | 0.1189560180550848 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 1.8667151043721375 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.6588367534458606 |
| Consumed energy (kWh) | 2.525551857817984 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.30438488349413273 |
| Emissions (Co2eq in kg) | 0.06193112348149021 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr2e4_x12 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0002 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82052 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 13.951132 | 12.776849 |
| 0.5 | 7.190272 | 7.126791 |
| 1.0 | 7.089954 | 7.082910 |
| 1.5 | 7.059654 | 7.051424 |
| 2.0 | 7.022353 | 7.017192 |
| 2.5 | 7.030577 | 7.017262 |
| 3.0 | 6.996768 | 6.997710 |
| 3.5 | 6.995896 | 6.994608 |
| 4.0 | 6.990964 | 6.986535 |
| 4.5 | 6.985115 | 6.988411 |
| 5.0 | 6.981623 | 6.999451 |
| 5.5 | 6.975148 | 6.980491 |
| 6.0 | 6.971244 | 6.975427 |
|