yazied49 commited on
Commit
1dfcd69
·
verified ·
1 Parent(s): de42780

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -87
README.md CHANGED
@@ -1,95 +1,27 @@
1
  ---
2
- library_name: transformers
3
- base_model: dmis-lab/biobert-base-cased-v1.1
4
- tags:
5
- - generated_from_trainer
6
- metrics:
7
- - accuracy
8
- - f1
9
- model-index:
10
- - name: disabilityy_model_final
11
- results: []
12
  pipeline_tag: text-classification
 
 
 
 
 
 
 
 
 
 
13
  ---
14
 
15
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
- should probably proofread and complete it, then remove this comment. -->
17
-
18
- # disabilityy_model_final
19
-
20
- This model is a fine-tuned version of [dmis-lab/biobert-base-cased-v1.1](https://huggingface.co/dmis-lab/biobert-base-cased-v1.1) on the None dataset.
21
- It achieves the following results on the evaluation set:
22
- - Loss: 0.7046
23
- - Accuracy: 0.9993
24
- - F1: 0.9993
25
-
26
- ## Model description
27
-
28
- More information needed
29
-
30
- ## Intended uses & limitations
31
-
32
- More information needed
33
-
34
- ## Training and evaluation data
35
-
36
- More information needed
37
-
38
- ## Training procedure
39
-
40
- ### Training hyperparameters
41
-
42
- The following hyperparameters were used during training:
43
- - learning_rate: 5e-05
44
- - train_batch_size: 8
45
- - eval_batch_size: 8
46
- - seed: 42
47
- - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
- - lr_scheduler_type: linear
49
- - num_epochs: 10
50
- - label_smoothing_factor: 0.1
51
-
52
- ### Training results
53
 
54
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
55
- |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|
56
- | 3.5334 | 0.1361 | 100 | 3.1591 | 0.3578 | 0.2920 |
57
- | 2.2694 | 0.2721 | 200 | 1.8688 | 0.8490 | 0.8256 |
58
- | 1.4181 | 0.4082 | 300 | 1.1307 | 0.9571 | 0.9541 |
59
- | 0.9179 | 0.5442 | 400 | 0.8041 | 0.9912 | 0.9911 |
60
- | 0.7608 | 0.6803 | 500 | 0.7383 | 0.9966 | 0.9966 |
61
- | 0.7273 | 0.8163 | 600 | 0.7282 | 0.9973 | 0.9973 |
62
- | 0.7196 | 0.9524 | 700 | 0.7239 | 0.9973 | 0.9973 |
63
- | 0.7178 | 1.0884 | 800 | 0.7175 | 0.9980 | 0.9980 |
64
- | 0.7111 | 1.2245 | 900 | 0.7165 | 0.9973 | 0.9973 |
65
- | 0.7121 | 1.3605 | 1000 | 0.7152 | 0.9986 | 0.9986 |
66
- | 0.7084 | 1.4966 | 1100 | 0.7117 | 0.9986 | 0.9986 |
67
- | 0.7079 | 1.6327 | 1200 | 0.7126 | 0.9980 | 0.9980 |
68
- | 0.7077 | 1.7687 | 1300 | 0.7108 | 0.9986 | 0.9986 |
69
- | 0.7076 | 1.9048 | 1400 | 0.7099 | 0.9993 | 0.9993 |
70
- | 0.7102 | 2.0408 | 1500 | 0.7088 | 0.9986 | 0.9986 |
71
- | 0.7049 | 2.1769 | 1600 | 0.7081 | 0.9986 | 0.9986 |
72
- | 0.7043 | 2.3129 | 1700 | 0.7077 | 0.9986 | 0.9986 |
73
- | 0.7041 | 2.4490 | 1800 | 0.7064 | 0.9993 | 0.9993 |
74
- | 0.7071 | 2.5850 | 1900 | 0.7086 | 0.9986 | 0.9986 |
75
- | 0.7042 | 2.7211 | 2000 | 0.7069 | 0.9993 | 0.9993 |
76
- | 0.7036 | 2.8571 | 2100 | 0.7057 | 0.9993 | 0.9993 |
77
- | 0.7032 | 2.9932 | 2200 | 0.7061 | 0.9993 | 0.9993 |
78
- | 0.7031 | 3.1293 | 2300 | 0.7059 | 0.9993 | 0.9993 |
79
- | 0.703 | 3.2653 | 2400 | 0.7055 | 0.9993 | 0.9993 |
80
- | 0.7033 | 3.4014 | 2500 | 0.7062 | 0.9993 | 0.9993 |
81
- | 0.7032 | 3.5374 | 2600 | 0.7062 | 0.9993 | 0.9993 |
82
- | 0.703 | 3.6735 | 2700 | 0.7054 | 0.9993 | 0.9993 |
83
- | 0.7028 | 3.8095 | 2800 | 0.7054 | 0.9993 | 0.9993 |
84
- | 0.7027 | 3.9456 | 2900 | 0.7046 | 0.9993 | 0.9993 |
85
- | 0.7027 | 4.0816 | 3000 | 0.7055 | 0.9993 | 0.9993 |
86
- | 0.7029 | 4.2177 | 3100 | 0.7051 | 0.9993 | 0.9993 |
87
- | 0.7026 | 4.3537 | 3200 | 0.7047 | 0.9993 | 0.9993 |
88
 
 
 
 
 
 
89
 
90
- ### Framework versions
91
 
92
- - Transformers 4.51.3
93
- - Pytorch 2.5.1+cu124
94
- - Datasets 3.6.0
95
- - Tokenizers 0.21.1
 
1
  ---
 
 
 
 
 
 
 
 
 
 
2
  pipeline_tag: text-classification
3
+ language: en
4
+ tags:
5
+ - disability
6
+ - text-classification
7
+ - healthcare
8
+ license: mit
9
+ datasets:
10
+ - custom
11
+ widget:
12
+ - text: "My child struggles to communicate clearly and often avoids social interaction."
13
  ---
14
 
15
+ # Disability Classification Model
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
+ This model classifies English text into one of 49 categories related to various disabilities, including:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
+ - Autism Spectrum Disorder
20
+ - ADHD
21
+ - Depression
22
+ - Down Syndrome
23
+ - and many more.
24
 
25
+ ## 🧪 Example
26
 
27
+ **Input:**