Hugging Face's logo

nlpaueb
/
sec-bert-base

Fill-Mask
Transformers
PyTorch
TensorFlow
English
bert
pretraining
finance
financial
Model card Files
xet
 Community
3
nlpaueb commited on
Commit
42bf91f
·
1 Parent(s): 4e711d3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -48,6 +48,48 @@ tokenizer = AutoTokenizer.from_pretrained("nlpaueb/sec-bert-base")
48
  model = AutoModel.from_pretrained("nlpaueb/sec-bert-base")
49
  ```
50
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  ## About Us
52
 
53
  [AUEB's Natural Language Processing Group](http://nlp.cs.aueb.gr) develops algorithms, models, and systems that allow computers to process and generate natural language texts.
 
48
  model = AutoModel.from_pretrained("nlpaueb/sec-bert-base")
49
  ```
50
 
51
+ ## Use LEBAL-BERT variants as Language Models
52
+
53
+ | Model | Masked token | Predictions |
54
+ | ---------------------------------- | ------------ | ------------ |
55
+ | Total net sales [MASK] 2% or $5.4 billion during 2019 compared to 2018.
56
+ | **BERT-BASE-UNCASED** | decreased | ('increased', '0.678'), ('decreased', '0.282'), ('declined', '0.017'), ('grew', '0.016'), ('rose', '0.004')
57
+ | **SEC-BERT-BASE** | decreased | ('increased', '0.678'), ('decreased', '0.282'), ('declined', '0.017'), ('grew', '0.016'), ('rose', '0.004')
58
+ | **SEC-BERT-NUM** | decreased | ('increased', '0.678'), ('decreased', '0.282'), ('declined', '0.017'), ('grew', '0.016'), ('rose', '0.004')
59
+ | **SEC-BERT-SHAPE** | decreased | ('increased', '0.678'), ('decreased', '0.282'), ('declined', '0.017'), ('grew', '0.016'), ('rose', '0.004')
60
+ | | |
61
+ | Total net sales decreased 2% or $5.4 [MASK] during 2019 compared to 2018.
62
+ | **BERT-BASE-UNCASED** | billion | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
63
+ | **SEC-BERT-BASE** | billion | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
64
+ | **SEC-BERT-NUM** | billion | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
65
+ | **SEC-BERT-SHAPE** | billion | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
66
+ | | |
67
+ | During 2019, the Company [MASK] $67.1 billion of its common stock and paid dividend equivalents of $14.1 billion.
68
+ | **BERT-BASE-UNCASED** | repurchased | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
69
+ | **SEC-BERT-BASE** | repurchased | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
70
+ | **SEC-BERT-NUM** | repurchased | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
71
+ | **SEC-BERT-SHAPE** | repurchased | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
72
+ | | |
73
+ | During 2019, the Company repurchased $67.1 billion of its common [MASK] and paid dividend equivalents of $14.1 billion.
74
+ | **BERT-BASE-UNCASED** | stock | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
75
+ | **SEC-BERT-BASE** | stock | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
76
+ | **SEC-BERT-NUM** | stock | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
77
+ | **SEC-BERT-SHAPE** | stock | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
78
+ | | |
79
+ | During 2019, the Company repurchased $67.1 billion of its common stock and paid [MASK] equivalents of $14.1 billion.
80
+ | **BERT-BASE-UNCASED** | dividend | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
81
+ | **SEC-BERT-BASE** | dividend | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
82
+ | **SEC-BERT-NUM** | dividend | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
83
+ | **SEC-BERT-SHAPE** | dividend | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
84
+ | | |
85
+ | During 2019, the Company repurchased $67.1 billion of its common stock and paid dividend [MASK] of $14.1 billion.
86
+ | **BERT-BASE-UNCASED** | equivalents | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
87
+ | **SEC-BERT-BASE** | equivalents | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
88
+ | **SEC-BERT-NUM** | equivalents | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
89
+ | **SEC-BERT-SHAPE** | equivalents | ('letter', '0.38'), ('dealer', '0.04'), ('employment', '0.03'), ('award', '0.03'), ('contribution', '0.02')
90
+ | | |
91
+
92
+
93
  ## About Us
94
 
95
  [AUEB's Natural Language Processing Group](http://nlp.cs.aueb.gr) develops algorithms, models, and systems that allow computers to process and generate natural language texts.