NitzanBar commited on
Commit
c9ff75f
·
verified ·
1 Parent(s): 2d46165

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -1,13 +1,18 @@
1
  ---
2
  license: apache-2.0
3
  ---
4
- Based ob the paper: UmlsBERT: Augmenting Contextual Embeddings with a Clinical Metathesaurus
 
5
  and the github repo: https://github.com/gmichalo/UmlsBERT
6
 
 
7
  Changing base model to SpanBert instead of Bert.
 
8
  Trained from scratch on MIMIC dataset, using the UMLS dataset to mask words within the text.
9
 
 
10
  We achived better accuracy on MedNLI dataset.
11
 
12
  Bert Model accuracy: 83%
 
13
  SpanBert Model accuracy: 86%
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ Based ob the paper: "UmlsBERT: Augmenting Contextual Embeddings with a Clinical Metathesaurus" (https://aclanthology.org/2021.naacl-main.139.pdf).
5
+
6
  and the github repo: https://github.com/gmichalo/UmlsBERT
7
 
8
+
9
  Changing base model to SpanBert instead of Bert.
10
+
11
  Trained from scratch on MIMIC dataset, using the UMLS dataset to mask words within the text.
12
 
13
+
14
  We achived better accuracy on MedNLI dataset.
15
 
16
  Bert Model accuracy: 83%
17
+
18
  SpanBert Model accuracy: 86%