File size: 3,110 Bytes
b098f40 85b9933 bfac1ea b098f40 85b9933 b098f40 85b9933 bfac1ea 85b9933 bfac1ea 85b9933 bfac1ea b098f40 85b9933 b098f40 85b9933 bfac1ea b098f40 85b9933 b098f40 85b9933 b098f40 85b9933 b098f40 85b9933 b098f40 85b9933 b098f40 85b9933 65aebe8 4abc4d4 cb65247 e305d14 c5e3b8d e572790 969d82b 8b1f698 3785bc4 b3d9d0a c525194 c2a3987 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-14T00:01:34'
project_name: ThunBERT_bs8_lr6_MLM_emissions_tracker
run_id: dd47eaec-ddea-4d60-96f9-97f621b6b7ac
duration: 223065.91824889183
emissions: 0.2334794830116918
emissions_rate: 1.046683800217211e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.6334121397880956
gpu_energy: 0
ram_energy: 2.323584166270997
energy_consumed: 4.956996306059145
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 223065.91824889183 |
| Emissions (Co2eq in kg) | 0.2334794830116918 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.6334121397880956 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 2.323584166270997 |
| Consumed energy (kWh) | 4.956996306059145 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.4294018926291167 |
| Emissions (Co2eq in kg) | 0.08736748464748263 |
## Note
11 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs8_lr6_MLM |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-06 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82599 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 9.572789 | 8.904013 |
| 0.5 | 2.721201 | 2.621082 |
| 1.0 | 2.571123 | 2.540323 |
| 1.5 | 2.501097 | 2.498298 |
| 2.0 | 2.474394 | 2.462365 |
| 2.5 | 2.439725 | 2.431248 |
| 3.0 | 2.406418 | 2.416753 |
| 3.5 | 2.394601 | 2.402248 |
| 4.0 | 2.376476 | 2.380821 |
| 4.5 | 2.358106 | 2.375012 |
| 5.0 | 2.358450 | 2.366301 |
| 5.5 | 2.346000 | 2.356987 |
| 6.0 | 2.341180 | 2.353812 |
|