Update README.md
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ All models were trained on the [Jean Zay](http://www.idris.fr/jean-zay/) French
|
|
| 30 |
|
| 31 |
| Model name | Corpus | Pretraining strategy | Sequence Length | Model URL |
|
| 32 |
| :------: | :---: | :---: | :---: | :---: |
|
| 33 |
-
| `DrLongformer` | NACHOS 7 GB | Further pretraining of [Clinical-Longformer](https://huggingface.co/yikuan8/Clinical-Longformer) | 4096 | [HuggingFace](https://huggingface.co/abazoge/DrLongformer) |
|
| 34 |
| `DrBERT-4096` | NACHOS 7 GB | Conversion of [DrBERT-7B](https://huggingface.co/Dr-BERT/DrBERT-7GB) to the Longformer architecture | 4096 | [HuggingFace](https://huggingface.co/abazoge/DrBERT-4096) |
|
| 35 |
| `DrLongformer-FS (from scratch)` | NACHOS 7 GB | Pretraining from scratch | 4096 | Not available |
|
| 36 |
|
|
|
|
| 30 |
|
| 31 |
| Model name | Corpus | Pretraining strategy | Sequence Length | Model URL |
|
| 32 |
| :------: | :---: | :---: | :---: | :---: |
|
| 33 |
+
| `DrLongformer (DrLonformer-CP)` | NACHOS 7 GB | Further pretraining of [Clinical-Longformer](https://huggingface.co/yikuan8/Clinical-Longformer) | 4096 | [HuggingFace](https://huggingface.co/abazoge/DrLongformer) |
|
| 34 |
| `DrBERT-4096` | NACHOS 7 GB | Conversion of [DrBERT-7B](https://huggingface.co/Dr-BERT/DrBERT-7GB) to the Longformer architecture | 4096 | [HuggingFace](https://huggingface.co/abazoge/DrBERT-4096) |
|
| 35 |
| `DrLongformer-FS (from scratch)` | NACHOS 7 GB | Pretraining from scratch | 4096 | Not available |
|
| 36 |
|