File size: 3,100 Bytes
71fe634 f3b7918 94dd8ea 71fe634 f3b7918 71fe634 f3b7918 94dd8ea f3b7918 94dd8ea f3b7918 94dd8ea 71fe634 f3b7918 71fe634 f3b7918 94dd8ea 71fe634 f3b7918 71fe634 f3b7918 71fe634 f3b7918 71fe634 f3b7918 71fe634 f3b7918 71fe634 f3b7918 242cfc9 4f4c1ce e0f5857 5c30b5f 999a898 36c8173 1b7b612 5ad6775 521839f b80afa0 72dda29 17d827f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-06-27T12:16:15'
project_name: fp_bs8_lr5_x2_emissions_tracker
run_id: 9f5c6e3b-754a-4a06-8831-72e4cf78a542
duration: 178032.19567131996
emissions: 0.1339344417550381
emissions_rate: 7.523046112530438e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.101764648015133
gpu_energy: 0
ram_energy: 0.7417937001099204
energy_consumed: 2.843558348125055
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 178032.19567131996 |
| Emissions (Co2eq in kg) | 0.1339344417550381 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.101764648015133 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7417937001099204 |
| Consumed energy (kWh) | 2.843558348125055 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3427119766672909 |
| Emissions (Co2eq in kg) | 0.06972927663793366 |
## Note
24 juin 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr5_x2 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 5e-05 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82155 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.030964 | 12.844445 |
| 0.5 | 7.084364 | 7.027704 |
| 1.0 | 7.006338 | 7.001563 |
| 1.5 | 6.987837 | 7.006575 |
| 2.0 | 6.985817 | 6.992814 |
| 2.5 | 6.978425 | 6.975868 |
| 3.0 | 6.978445 | 6.985299 |
| 3.5 | 6.971340 | 6.978874 |
| 4.0 | 6.967529 | 6.974467 |
| 4.5 | 6.971424 | 6.964084 |
| 5.0 | 6.935638 | 6.922034 |
| 5.5 | 6.917486 | 6.915976 |
| 6.0 | 6.902220 | 6.896220 |
|