File size: 3,096 Bytes
4bc7605 5a55706 c7fdd25 5a55706 c7fdd25 5a55706 c7fdd25 5a55706 c7fdd25 5a55706 4bc7605 5a55706 4bc7605 5a55706 c7fdd25 5a55706 c7fdd25 5a55706 c7fdd25 5a55706 4bc7605 5a55706 4bc7605 5a55706 c7fdd25 4bc7605 5a55706 4bc7605 5a55706 4bc7605 5a55706 4bc7605 5a55706 4bc7605 5a55706 4bc7605 5a55706 ba05fc7 69c7c8f a22d29f a3825b0 cef4455 f7768ce 3c542bc e1180bc 9b03280 ab2f773 969d3a8 d4933fb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-05-17T17:46:44'
project_name: ThunBERT_bs8_lr5_emissions_tracker
run_id: 525cc3ea-c30d-41f0-83c7-26fb501d8395
duration: 199505.3919699192
emissions: 0.2088190820973
emissions_rate: 1.0466839018004345e-06
cpu_power: 42.5
gpu_power: 0.0
ram_power: 37.5
cpu_energy: 2.3552678664051694
gpu_energy: 0
ram_energy: 2.078164164704575
energy_consumed: 4.433432031109744
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 4
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 100
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 199505.3919699192 |
| Emissions (Co2eq in kg) | 0.2088190820973 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 37.5 |
| CPU energy (kWh) | 2.3552678664051694 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 2.078164164704575 |
| Consumed energy (kWh) | 4.433432031109744 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 4 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.38404787954209446 |
| Emissions (Co2eq in kg) | 0.07813961185488502 |
## Note
15 May 2024
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | ThunBERT_bs8_lr5 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82627 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 7.067743 | 3.953574 |
| 0.5 | 3.522399 | 3.376064 |
| 1.0 | 3.303520 | 3.226876 |
| 1.5 | 3.154914 | 3.167486 |
| 2.0 | 3.058335 | 3.051049 |
| 2.5 | 2.983440 | 2.994546 |
| 3.0 | 2.966602 | 2.926526 |
| 3.5 | 2.846851 | 2.879127 |
| 4.0 | 2.785210 | 2.832286 |
| 4.5 | 2.718725 | 2.795912 |
| 5.0 | 2.670722 | 2.733300 |
| 5.5 | 2.628934 | 2.693741 |
| 6.0 | 2.589258 | 2.672380 |
|