File size: 3,108 Bytes
727221c d738204 ba31461 727221c d738204 727221c d738204 ba31461 d738204 ba31461 d738204 ba31461 727221c d738204 727221c d738204 ba31461 727221c d738204 727221c d738204 727221c d738204 727221c d738204 fd78ba3 727221c d738204 727221c d738204 fd78ba3 b36e2d2 fbbdd30 3af6077 d74412e f6b2fb1 69c5bbf fb3677e 065bf8c d3edfeb 2d9c84b 67287e1 16c74f5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-10T01:04:35'
project_name: fp_bs8_lr1e4_x1_emissions_tracker
run_id: 5345fbf7-aa3f-4851-be4d-d4f22b6bd5de
duration: 177902.95831775665
emissions: 0.1338371668679234
emissions_rate: 7.523043356528887e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.100238193338611
gpu_energy: 0
ram_energy: 0.7412549144069336
energy_consumed: 2.8414931077455567
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 177902.95831775665 |
| Emissions (Co2eq in kg) | 0.1338371668679234 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.100238193338611 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.7412549144069336 |
| Consumed energy (kWh) | 2.8414931077455567 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3424631947616815 |
| Emissions (Co2eq in kg) | 0.06967865867445468 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr1e4_x1 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0001 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 82820 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 10.597891 | 4.233626 |
| 0.5 | 7.036702 | 7.024708 |
| 1.0 | 7.007983 | 7.016265 |
| 1.5 | 6.992748 | 6.995505 |
| 2.0 | 6.987995 | 6.993249 |
| 2.5 | 6.980353 | 6.984379 |
| 3.0 | 6.970201 | 6.977975 |
| 3.5 | 6.969172 | 6.973708 |
| 4.0 | 6.969255 | 6.972256 |
| 4.5 | 6.959313 | 6.950441 |
| 5.0 | 6.932130 | 6.929126 |
| 5.5 | 6.909282 | 6.910709 |
| 6.0 | 6.904310 | 6.907994 |
|