Hugging Face's logo

Recognai
/
selectra_medium

Transformers
PyTorch
Spanish
electra
pretraining
Model card Files
xet
Community
1
David commited on
Commit
17e0fad
·
1 Parent(s): 296e183

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ We release a `small` and `medium` version with the following configuration:
15
  | Model | Layers | Embedding/Hidden Size | Params | Vocab Size | Max Sequence Length | Cased |
16
  | --- | --- | --- | --- | --- | --- | --- |
17
  | [SELECTRA small](https://huggingface.co/Recognai/selectra_small) | 12 | 256 | 22M | 50k | 512 | True |
18
- | **SELECTRA medium**] | **12** | **384** | **41M** | **50k** | **512** | **True** |
19
 
20
  Selectra small (medium) is about 5 (3) times smaller than BETO but achieves comparable results (see Metrics section below).
21
 
 
15
  | Model | Layers | Embedding/Hidden Size | Params | Vocab Size | Max Sequence Length | Cased |
16
  | --- | --- | --- | --- | --- | --- | --- |
17
  | [SELECTRA small](https://huggingface.co/Recognai/selectra_small) | 12 | 256 | 22M | 50k | 512 | True |
18
+ | **SELECTRA medium** | **12** | **384** | **41M** | **50k** | **512** | **True** |
19
 
20
  Selectra small (medium) is about 5 (3) times smaller than BETO but achieves comparable results (see Metrics section below).
21