AIEngineerYvar commited on
Commit
0b6bcf5
·
verified ·
1 Parent(s): 0011981

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -2
README.md CHANGED
@@ -11,5 +11,67 @@ library_name: transformers
11
  tags:
12
  - medical
13
  - healthcare
14
- --
15
- Model Name: DeepNeural_NER-I
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  tags:
12
  - medical
13
  - healthcare
14
+ ---
15
+ # Model Name: DeepNeural_NER-I
16
+
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # Bert-base-uncased
21
+
22
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on the medical-ner-bleurt-separated dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.0
25
+ - F1: 1.0
26
+
27
+ ## Model description
28
+
29
+ The DeepNeural NER-I model is exclusively designed to identify body parts in textual documents.
30
+ This clinical support model is one of many to be released, and is a crucial aspect of clinical support systems.
31
+
32
+ ## Intended uses & limitations
33
+
34
+ The model is meant to be used for research and development purposes by Data Scientists, ML & Software Engineers for the development of NER applications
35
+ capable of identifying body parts in medical EHR systems to augment patient health processing.
36
+
37
+ ## Training and evaluation data
38
+
39
+ Training
40
+
41
+ ## Training procedure
42
+ The DeepNeural_NER-I model was trained with precision and accuracy in mind, and therefore
43
+ the model was trained for 3 epochs and 13500 global steps per epoch. The training scores utilized
44
+ are highlighted in the table below.
45
+
46
+ | Training Method | # Score |
47
+ |:-------------:|:-----:|
48
+ | Precision | 1.0 |
49
+ | Recall | 1.0 |
50
+ | F1-Score | 1.0 |
51
+ | Accuracy | 1.0 |
52
+
53
+ ### Training hyperparameters
54
+
55
+ The following hyperparameters were used during training:
56
+ - learning_rate: 2e-05
57
+ - train_batch_size: 24
58
+ - eval_batch_size: 24
59
+ - lr_scheduler_type: linear
60
+ - num_epochs: 3
61
+ - weight_decay: 0.01
62
+
63
+ ### Training results
64
+
65
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
66
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
67
+ | 0.2775 | 1.0 | 715 | 0.1784 | 0.8323 |
68
+ | 0.146 | 2.0 | 1430 | 0.1624 | 0.8461 |
69
+ | 0.0926 | 3.0 | 2145 | 0.1646 | 0.8587 |
70
+
71
+
72
+ ### Framework versions
73
+
74
+ - Transformers 4.56.1
75
+ - Pytorch 2.8.0+cu126
76
+ - Datasets 4.0.0
77
+ - Tokenizers 0.22.0