File size: 3,113 Bytes
6cfd361 5f5273d 12d66af 6cfd361 5f5273d 6cfd361 5f5273d 12d66af 5f5273d 12d66af 5f5273d 12d66af 6cfd361 5f5273d 6cfd361 5f5273d 12d66af 6cfd361 5f5273d 6cfd361 5f5273d 6cfd361 5f5273d 6cfd361 5f5273d 6cfd361 5f5273d 6cfd361 5f5273d abd81bc 76cb93c 6b16ed0 124eab6 b98cd6a 2715ee3 7335211 e0f13f0 af61651 00f8f8b 646d7c8 d7ea04c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-13T23:46:31'
project_name: ThunBERT_bs8_lr5_MLM_emissions_tracker
run_id: 761a7792-77be-4658-b626-ebb9f6540510
duration: 222194.28785967827
emissions: 0.2325671263715923
emissions_rate: 1.0466836416535818e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.6231219651492017
gpu_energy: 0
ram_energy: 2.314504122865692
energy_consumed: 4.937626088014953
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 222194.28785967827 |
| Emissions (Co2eq in kg) | 0.2325671263715923 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.6231219651492017 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 2.314504122865692 |
| Consumed energy (kWh) | 4.937626088014953 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.42772400412988065 |
| Emissions (Co2eq in kg) | 0.08702609607837399 |
## Note
11 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs8_lr5_MLM |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82533 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 10.169299 | 3.893429 |
| 0.5 | 2.974144 | 2.843656 |
| 1.0 | 2.783727 | 2.781645 |
| 1.5 | 2.678597 | 2.669879 |
| 2.0 | 2.595359 | 2.603173 |
| 2.5 | 2.525631 | 2.518131 |
| 3.0 | 2.453879 | 2.475023 |
| 3.5 | 2.397467 | 2.423880 |
| 4.0 | 2.351636 | 2.381376 |
| 4.5 | 2.294014 | 2.340238 |
| 5.0 | 2.253481 | 2.299134 |
| 5.5 | 2.208159 | 2.264561 |
| 6.0 | 2.192403 | 2.241567 |
|