cedricbonhomme commited on
Commit
8328207
·
verified ·
1 Parent(s): a21de9f

End of training

Browse files
Files changed (2) hide show
  1. README.md +18 -49
  2. emissions.csv +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  library_name: transformers
3
- license: cc-by-4.0
4
  base_model: roberta-base
5
  tags:
6
  - generated_from_trainer
@@ -9,56 +9,29 @@ metrics:
9
  model-index:
10
  - name: vulnerability-severity-classification-roberta-base
11
  results: []
12
- datasets:
13
- - CIRCL/vulnerability-scores
14
  ---
15
 
 
 
16
 
17
- # VLAI: A RoBERTa-Based Model for Automated Vulnerability Severity Classification
18
-
19
- # Severity classification
20
-
21
- This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on the dataset [CIRCL/vulnerability-scores](https://huggingface.co/datasets/CIRCL/vulnerability-scores).
22
-
23
- The model was presented in the paper [VLAI: A RoBERTa-Based Model for Automated Vulnerability Severity Classification](https://huggingface.co/papers/2507.03607) [[arXiv](https://arxiv.org/abs/2507.03607)].
24
-
25
- **Abstract:** VLAI is a transformer-based model that predicts software vulnerability severity levels directly from text descriptions. Built on RoBERTa, VLAI is fine-tuned on over 600,000 real-world vulnerabilities and achieves over 82% accuracy in predicting severity categories, enabling faster and more consistent triage ahead of manual CVSS scoring. The model and dataset are open-source and integrated into the Vulnerability-Lookup service.
26
-
27
- You can read [this page](https://www.vulnerability-lookup.org/user-manual/ai/) for more information.
28
 
 
 
 
 
29
 
30
  ## Model description
31
 
32
- It is a classification model and is aimed to assist in classifying vulnerabilities by severity based on their descriptions.
33
 
34
- ## How to get started with the model
35
 
36
- ```python
37
- from transformers import AutoModelForSequenceClassification, AutoTokenizer
38
- import torch
39
 
40
- labels = ["low", "medium", "high", "critical"]
41
-
42
- model_name = "CIRCL/vulnerability-severity-classification-roberta-base"
43
- tokenizer = AutoTokenizer.from_pretrained(model_name)
44
- model = AutoModelForSequenceClassification.from_pretrained(model_name)
45
- model.eval()
46
-
47
- test_description = "SAP NetWeaver Visual Composer Metadata Uploader is not protected with a proper authorization, allowing unauthenticated agent to upload potentially malicious executable binaries \
48
- that could severely harm the host system. This could significantly affect the confidentiality, integrity, and availability of the targeted system."
49
- inputs = tokenizer(test_description, return_tensors="pt", truncation=True, padding=True)
50
-
51
- # Run inference
52
- with torch.no_grad():
53
- outputs = model(**inputs)
54
- predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)
55
-
56
- # Print results
57
- print("Predictions:", predictions)
58
- predicted_class = torch.argmax(predictions, dim=-1).item()
59
- print("Predicted severity:", labels[predicted_class])
60
- ```
61
 
 
62
 
63
  ## Training procedure
64
 
@@ -73,19 +46,15 @@ The following hyperparameters were used during training:
73
  - lr_scheduler_type: linear
74
  - num_epochs: 5
75
 
76
- It achieves the following results on the evaluation set:
77
- - Loss: 0.5031
78
- - Accuracy: 0.8187
79
-
80
  ### Training results
81
 
82
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
83
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
84
- | 0.6673 | 1.0 | 14844 | 0.6391 | 0.7368 |
85
- | 0.5797 | 2.0 | 29688 | 0.5856 | 0.7665 |
86
- | 0.4497 | 3.0 | 44532 | 0.5307 | 0.7909 |
87
- | 0.4976 | 4.0 | 59376 | 0.4956 | 0.8106 |
88
- | 0.3331 | 5.0 | 74220 | 0.5031 | 0.8187 |
89
 
90
 
91
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ license: mit
4
  base_model: roberta-base
5
  tags:
6
  - generated_from_trainer
 
9
  model-index:
10
  - name: vulnerability-severity-classification-roberta-base
11
  results: []
 
 
12
  ---
13
 
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
 
17
+ # vulnerability-severity-classification-roberta-base
 
 
 
 
 
 
 
 
 
 
18
 
19
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.4991
22
+ - Accuracy: 0.8220
23
 
24
  ## Model description
25
 
26
+ More information needed
27
 
28
+ ## Intended uses & limitations
29
 
30
+ More information needed
 
 
31
 
32
+ ## Training and evaluation data
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
 
34
+ More information needed
35
 
36
  ## Training procedure
37
 
 
46
  - lr_scheduler_type: linear
47
  - num_epochs: 5
48
 
 
 
 
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:-----:|:---------------:|:--------:|
53
+ | 0.6222 | 1.0 | 14910 | 0.6437 | 0.7380 |
54
+ | 0.5698 | 2.0 | 29820 | 0.5763 | 0.7693 |
55
+ | 0.4436 | 3.0 | 44730 | 0.5286 | 0.7940 |
56
+ | 0.4032 | 4.0 | 59640 | 0.5050 | 0.8121 |
57
+ | 0.361 | 5.0 | 74550 | 0.4991 | 0.8220 |
58
 
59
 
60
  ### Framework versions
emissions.csv CHANGED
@@ -1,2 +1,2 @@
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
- 2025-12-14T20:01:49,codecarbon,5034227f-59fc-413e-b9ff-d2fc146caed0,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,13842.663856844185,0.6726782285329427,4.859456499771556e-05,42.5,618.612633160644,755.7507891654968,0.16313088899330916,3.3268904181768746,2.9004314495719026,6.39045275674209,Luxembourg,LUX,,,,Linux-6.8.0-88-generic-x86_64-with-glibc2.39,3.12.3,2.8.4,224,Intel(R) Xeon(R) Platinum 8480+,4,4 x NVIDIA L40S,6.1661,49.7498,2015.3354377746582,machine,N,1.0
 
1
  timestamp,project_name,run_id,experiment_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
+ 2025-12-19T11:10:16,codecarbon,cdcdd756-635b-4f29-b0ec-e91c473aea02,5b0fa12a-3dd7-45bb-9766-cc326314d9f1,13817.517110989002,0.6724297955654165,4.8665023546859696e-05,42.5,631.280587304452,755.7507834434509,0.16282157506733172,3.3303747298532085,2.8948963350898853,6.388092640010416,Luxembourg,LUX,,,,Linux-6.8.0-90-generic-x86_64-with-glibc2.39,3.12.3,2.8.4,224,Intel(R) Xeon(R) Platinum 8480+,4,4 x NVIDIA L40S,6.1661,49.7498,2015.3354225158691,machine,N,1.0