File size: 3,104 Bytes
45d7911 36c34eb 28a4188 45d7911 36c34eb 45d7911 36c34eb 28a4188 36c34eb 28a4188 36c34eb 28a4188 45d7911 36c34eb 45d7911 36c34eb 28a4188 45d7911 36c34eb 45d7911 36c34eb 45d7911 36c34eb 45d7911 36c34eb 6330e18 45d7911 36c34eb 45d7911 36c34eb 6330e18 248478c 6fc0f51 90bc168 7f520cf b701485 46a16ea e56e2d5 fb30fdb 1012239 2055da8 d4185a0 57373ee | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-10T00:56:33'
project_name: fp_bs8_lr1e4_x2_emissions_tracker
run_id: 59cb50bf-c3e6-43a1-8b7b-2bfb5713f38b
duration: 177421.5589568615
emissions: 0.1334750406979024
emissions_rate: 7.523045197137272e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.0945555037395738
gpu_energy: 0
ram_energy: 0.739249313523375
energy_consumed: 2.833804817262955
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 177421.5589568615 |
| Emissions (Co2eq in kg) | 0.1334750406979024 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.0945555037395738 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.739249313523375 |
| Consumed energy (kWh) | 2.833804817262955 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3415365009919584 |
| Emissions (Co2eq in kg) | 0.06949011059143742 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr1e4_x2 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0001 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 83254 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 14.699384 | 8.961090 |
| 0.5 | 4.739969 | 3.821362 |
| 1.0 | 3.560692 | 3.402070 |
| 1.5 | 3.271684 | 3.207227 |
| 2.0 | 5.506532 | 6.965374 |
| 2.5 | 6.963911 | 6.979262 |
| 3.0 | 6.981505 | 6.987962 |
| 3.5 | 6.974114 | 6.985355 |
| 4.0 | 6.976612 | 6.973448 |
| 4.5 | 6.968990 | 6.975167 |
| 5.0 | 6.969795 | 6.971316 |
| 5.5 | 6.970071 | 6.966503 |
| 6.0 | 6.955143 | 6.965822 |
|