File size: 3,104 Bytes
228ea39 9d3338f 42b6d91 9d3338f 42b6d91 9d3338f 42b6d91 9d3338f 42b6d91 9d3338f 228ea39 9d3338f 228ea39 9d3338f 42b6d91 9d3338f 42b6d91 9d3338f 42b6d91 9d3338f 228ea39 9d3338f 228ea39 9d3338f 42b6d91 228ea39 9d3338f 228ea39 9d3338f 228ea39 9d3338f 228ea39 9d3338f 228ea39 9d3338f 228ea39 9d3338f f9c98f7 31af40e dae2ac7 f7c504a 658ee82 5ea6e76 4eaf7e8 0893270 bff6531 910d9b0 8f9a5d6 c275148 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T17:37:08'
project_name: ThunBERT_bs8_lr6_emissions_tracker
run_id: bc27cf9a-2204-4f64-839a-c4143d73154b
duration: 198898.01198983192
emissions: 0.208183339930801
emissions_rate: 1.0466838650023502e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.3480973135006087
gpu_energy: 0
ram_energy: 2.0718372936372944
energy_consumed: 4.419934607137876
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 198898.01198983192 |
| Emissions (Co2eq in kg) | 0.208183339930801 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.3480973135006087 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 2.0718372936372944 |
| Consumed energy (kWh) | 4.419934607137876 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.38287867308042645 |
| Emissions (Co2eq in kg) | 0.07790172136268415 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs8_lr6 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-06 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82526 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 5.880861 | 5.300246 |
| 0.5 | 3.103968 | 2.962697 |
| 1.0 | 2.958498 | 2.898160 |
| 1.5 | 2.900805 | 2.852431 |
| 2.0 | 2.848759 | 2.819438 |
| 2.5 | 2.822495 | 2.790958 |
| 3.0 | 2.789580 | 2.759134 |
| 3.5 | 2.772316 | 2.749335 |
| 4.0 | 2.743679 | 2.741200 |
| 4.5 | 2.743601 | 2.715535 |
| 5.0 | 2.717224 | 2.709640 |
| 5.5 | 2.715036 | 2.697720 |
| 6.0 | 2.705022 | 2.699902 |
|