Text Classification
Transformers
Safetensors
roberta
Generated from Trainer
classification
nlp
vulnerability
cedricbonhomme commited on
Commit
96f8d94
·
verified ·
1 Parent(s): ceda147

End of training

Browse files
Files changed (3) hide show
  1. README.md +9 -9
  2. emissions.csv +1 -1
  3. model.safetensors +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.4991
22
- - Accuracy: 0.8220
23
 
24
  ## Model description
25
 
@@ -39,8 +39,8 @@ More information needed
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 3e-05
42
- - train_batch_size: 32
43
- - eval_batch_size: 32
44
  - seed: 42
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
@@ -50,11 +50,11 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
- | 0.6222 | 1.0 | 14910 | 0.6437 | 0.7380 |
54
- | 0.5698 | 2.0 | 29820 | 0.5763 | 0.7693 |
55
- | 0.4436 | 3.0 | 44730 | 0.5286 | 0.7940 |
56
- | 0.4032 | 4.0 | 59640 | 0.5050 | 0.8121 |
57
- | 0.361 | 5.0 | 74550 | 0.4991 | 0.8220 |
58
 
59
 
60
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.5089
22
+ - Accuracy: 0.8172
23
 
24
  ## Model description
25
 
 
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 3e-05
42
+ - train_batch_size: 24
43
+ - eval_batch_size: 24
44
  - seed: 42
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
+ | 0.6253 | 1.0 | 19925 | 0.6421 | 0.7414 |
54
+ | 0.5716 | 2.0 | 39850 | 0.5873 | 0.7678 |
55
+ | 0.5358 | 3.0 | 59775 | 0.5411 | 0.7885 |
56
+ | 0.4572 | 4.0 | 79700 | 0.5065 | 0.8079 |
57
+ | 0.3103 | 5.0 | 99625 | 0.5089 | 0.8172 |
58
 
59
 
60
  ### Framework versions
emissions.csv CHANGED
@@ -1,2 +1,2 @@
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
- 2025-12-19T11:10:16,codecarbon,cdcdd756-635b-4f29-b0ec-e91c473aea02,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,13817.517110989002,0.6724297955654165,4.8665023546859696e-05,42.5,631.280587304452,755.7507834434509,0.16282157506733172,3.3303747298532085,2.8948963350898853,6.388092640010416,Luxembourg,LUX,,,,Linux-6.8.0-90-generic-x86_64-with-glibc2.39,3.12.3,2.8.4,224,Intel(R) Xeon(R) Platinum 8480+,4,4 x NVIDIA L40S,6.1661,49.7498,2015.3354225158691,machine,N,1.0
 
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
+ 2025-12-24T17:11:32,codecarbon,aebd8f0c-5188-496e-a8f0-052694d6ddef,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,17211.53679475299,0.7419395965197659,4.3107109223735876e-05,42.5,266.2795884223949,755.7507834434509,0.20285793294097065,3.2387516079436622,3.6068271987082583,7.048436739592885,Luxembourg,LUX,,,,Linux-6.8.0-90-generic-x86_64-with-glibc2.39,3.12.3,2.8.4,224,Intel(R) Xeon(R) Platinum 8480+,3,3 x NVIDIA L40S,6.1661,49.7498,2015.3354225158691,machine,N,1.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c466ac81d7932c8330ed890e0cc44b014c1b368071efc3b7f4f86c99cb124af
3
  size 498618976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b923b4e0aeac38c104f51e5d71c12c5b924abec43d738dfa1e1ff9b320e8493
3
  size 498618976