File size: 3,109 Bytes
4577de1 83ddc8e 0d63d6b 4577de1 83ddc8e 4577de1 83ddc8e 0d63d6b 83ddc8e 0d63d6b 83ddc8e 0d63d6b 4577de1 83ddc8e 4577de1 83ddc8e 0d63d6b 4577de1 83ddc8e 4577de1 83ddc8e 4577de1 83ddc8e 4577de1 83ddc8e 29844a6 4577de1 83ddc8e 4577de1 83ddc8e 29844a6 690ae1b 18ab365 592ee47 baace0f 5528e41 a1ec420 424b816 98f6bf7 67d96b2 480bb3d 1442614 bea4c5f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 | ---
language: en
tags:
- fill-mask
kwargs:
timestamp: '2024-07-10T05:04:16'
project_name: fp_bs8_lr1e4_x4_emissions_tracker
run_id: 868af11c-5790-4ef1-8789-c310e25245ff
duration: 192283.67964935303
emissions: 0.1446556131795172
emissions_rate: 7.523031254826723e-07
cpu_power: 42.5
gpu_power: 0.0
ram_power: 15.0
cpu_energy: 2.2700089682180074
gpu_energy: 0
ram_energy: 0.8011702674567661
energy_consumed: 3.071179235674767
country_name: Switzerland
country_iso_code: CHE
region: .nan
cloud_provider: .nan
cloud_region: .nan
os: Linux-5.14.0-70.30.1.el9_0.x86_64-x86_64-with-glibc2.34
python_version: 3.10.4
codecarbon_version: 2.3.4
cpu_count: 6
cpu_model: Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz
gpu_count: .nan
gpu_model: .nan
longitude: .nan
latitude: .nan
ram_total_size: 40
tracking_mode: machine
on_cloud: N
pue: 1.0
---
## Environmental Impact (CODE CARBON DEFAULT)
| Metric | Value |
|--------------------------|---------------------------------|
| Duration (in seconds) | 192283.67964935303 |
| Emissions (Co2eq in kg) | 0.1446556131795172 |
| CPU power (W) | 42.5 |
| GPU power (W) | [No GPU] |
| RAM power (W) | 15.0 |
| CPU energy (kWh) | 2.2700089682180074 |
| GPU energy (kWh) | [No GPU] |
| RAM energy (kWh) | 0.8011702674567661 |
| Consumed energy (kWh) | 3.071179235674767 |
| Country name | Switzerland |
| Cloud provider | nan |
| Cloud region | nan |
| CPU count | 6 |
| CPU model | Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz |
| GPU count | nan |
| GPU model | nan |
## Environmental Impact (for one core)
| Metric | Value |
|--------------------------|---------------------------------|
| CPU energy (kWh) | 0.3701460833250046 |
| Emissions (Co2eq in kg) | 0.07531110786266326 |
## Note
5 juillet 2024 !
## My Config
| Config | Value |
|--------------------------|-----------------|
| checkpoint | albert-base-v2 |
| model_name | fp_bs8_lr1e4_x4 |
| sequence_length | 400 |
| num_epoch | 6 |
| learning_rate | 0.0001 |
| batch_size | 8 |
| weight_decay | 0.0 |
| warm_up_prop | 0.0 |
| drop_out_prob | 0.1 |
| packing_length | 100 |
| train_test_split | 0.2 |
| num_steps | 81709 |
## Training and Testing steps
Epoch | Train Loss | Test Loss
---|---|---
| 0.0 | 17.859739 | 13.066814 |
| 0.5 | 3.997183 | 3.593726 |
| 1.0 | 3.391947 | 3.265344 |
| 1.5 | 6.459209 | 6.977757 |
| 2.0 | 6.985903 | 6.983891 |
| 2.5 | 6.982025 | 7.001526 |
| 3.0 | 6.995377 | 6.998771 |
| 3.5 | 6.984867 | 6.995654 |
| 4.0 | 6.984822 | 6.994850 |
| 4.5 | 6.975999 | 6.984660 |
| 5.0 | 6.978274 | 6.982478 |
| 5.5 | 6.975072 | 6.977838 |
| 6.0 | 6.976715 | 6.982384 |
|