codechrl commited on
Commit
bad8f42
·
verified ·
1 Parent(s): 97c7ce9

Training update: 3,116/237,957 rows (1.31%) | +100 new @ 2025-10-21 11:48:19

Browse files
Files changed (4) hide show
  1. README.md +3 -8
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
  4. training_metadata.json +5 -5
README.md CHANGED
@@ -9,13 +9,8 @@ tags:
9
  - cybersecurity
10
  - fill-mask
11
  - named-entity-recognition
12
- - transformers
13
- - tensorflow
14
- - pytorch
15
- - masked-language-modeling
16
  base_model: boltuix/bert-micro
17
  library_name: transformers
18
- pipeline_tag: fill-mask
19
  ---
20
  # bert-micro-cybersecurity
21
 
@@ -26,7 +21,7 @@ pipeline_tag: fill-mask
26
  - Model type: fine-tuned lightweight BERT variant
27
  - Languages: English & Indonesia
28
  - Finetuned from: `boltuix/bert-micro`
29
- - Status: **Early version** — trained on **1.27%** of planned data.
30
 
31
  **Model sources**
32
  - Base model: [boltuix/bert-micro](https://huggingface.co/boltuix/bert-micro)
@@ -47,7 +42,7 @@ You can use this model to classify cybersecurity-related text — for example, w
47
  - Not tested for non-cybersecurity domains or out-of-distribution data.
48
 
49
  ## 3. Bias, Risks, and Limitations
50
- Because the model is based on a small subset (1.27%) of planned data, performance is preliminary and may degrade on unseen or specialized domains (industrial control, IoT logs, foreign language).
51
 
52
  - Inherits any biases present in the base model (`boltuix/bert-micro`) and in the fine-tuning data — e.g., over-representation of certain threat types, vendor or tooling-specific vocabulary.
53
  - Should not be used as sole authority for incident decisions; only as an aid to human analysts.
@@ -67,7 +62,7 @@ predicted_class = logits.argmax(dim=-1).item()
67
  ```
68
 
69
  ## 5. Training Details
70
- - **Trained records**: 3,016 / 237,957 (1.27%)
71
  - **Learning rate**: 5e-05
72
  - **Epochs**: 3
73
  - **Batch size**: 16
 
9
  - cybersecurity
10
  - fill-mask
11
  - named-entity-recognition
 
 
 
 
12
  base_model: boltuix/bert-micro
13
  library_name: transformers
 
14
  ---
15
  # bert-micro-cybersecurity
16
 
 
21
  - Model type: fine-tuned lightweight BERT variant
22
  - Languages: English & Indonesia
23
  - Finetuned from: `boltuix/bert-micro`
24
+ - Status: **Early version** — trained on **1.31%** of planned data.
25
 
26
  **Model sources**
27
  - Base model: [boltuix/bert-micro](https://huggingface.co/boltuix/bert-micro)
 
42
  - Not tested for non-cybersecurity domains or out-of-distribution data.
43
 
44
  ## 3. Bias, Risks, and Limitations
45
+ Because the model is based on a small subset (1.31%) of planned data, performance is preliminary and may degrade on unseen or specialized domains (industrial control, IoT logs, foreign language).
46
 
47
  - Inherits any biases present in the base model (`boltuix/bert-micro`) and in the fine-tuning data — e.g., over-representation of certain threat types, vendor or tooling-specific vocabulary.
48
  - Should not be used as sole authority for incident decisions; only as an aid to human analysts.
 
62
  ```
63
 
64
  ## 5. Training Details
65
+ - **Trained records**: 3,116 / 237,957 (1.31%)
66
  - **Learning rate**: 5e-05
67
  - **Epochs**: 3
68
  - **Batch size**: 16
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1b6a9ba7dbef061ef3a4a4f85937601b1f6f598bd789df8e7804ad3c3425bb8
3
  size 17671560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:583f4fb0896e13bba170d0e0dbf2470093c6b803cbb1aace70868eace83b7cc3
3
  size 17671560
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b33f116a5a4c8825de97e08426b77f51aece13c2ebe9394937fe22865e4eb7ae
3
  size 5905
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0698d5f1ca4096f87970681a4fc99b8eb8828f6b682761a992c2b75d3a9ffeb4
3
  size 5905
training_metadata.json CHANGED
@@ -1,11 +1,11 @@
1
  {
2
- "trained_at": 1761046953.984294,
3
- "trained_at_readable": "2025-10-21 11:42:33",
4
- "samples_this_session": 343,
5
  "new_rows_this_session": 100,
6
- "trained_rows_total": 3016,
7
  "total_db_rows": 237957,
8
- "percentage": 1.2674558848867652,
9
  "final_loss": 0,
10
  "epochs": 3,
11
  "learning_rate": 5e-05
 
1
  {
2
+ "trained_at": 1761047299.4826186,
3
+ "trained_at_readable": "2025-10-21 11:48:19",
4
+ "samples_this_session": 400,
5
  "new_rows_this_session": 100,
6
+ "trained_rows_total": 3116,
7
  "total_db_rows": 237957,
8
+ "percentage": 1.3094802842530373,
9
  "final_loss": 0,
10
  "epochs": 3,
11
  "learning_rate": 5e-05