Update README.md
Browse files
README.md
CHANGED
|
@@ -55,6 +55,8 @@ More information needed
|
|
| 55 |
|
| 56 |
## Training procedure
|
| 57 |
|
|
|
|
|
|
|
| 58 |
### Training hyperparameters
|
| 59 |
|
| 60 |
The following hyperparameters were used during training:
|
|
@@ -68,11 +70,27 @@ The following hyperparameters were used during training:
|
|
| 68 |
|
| 69 |
### Training results
|
| 70 |
|
| 71 |
-
|
| 72 |
|
| 73 |
### Framework versions
|
| 74 |
|
| 75 |
- Transformers 4.33.3
|
| 76 |
- Pytorch 2.0.1+cu117
|
| 77 |
- Datasets 2.14.5
|
| 78 |
-
- Tokenizers 0.13.3
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
|
| 56 |
## Training procedure
|
| 57 |
|
| 58 |
+
Dedicated Byte Level BPE tokenizer vocabulary size 2**16, min frequency 2
|
| 59 |
+
|
| 60 |
### Training hyperparameters
|
| 61 |
|
| 62 |
The following hyperparameters were used during training:
|
|
|
|
| 70 |
|
| 71 |
### Training results
|
| 72 |
|
| 73 |
+
Coming soon
|
| 74 |
|
| 75 |
### Framework versions
|
| 76 |
|
| 77 |
- Transformers 4.33.3
|
| 78 |
- Pytorch 2.0.1+cu117
|
| 79 |
- Datasets 2.14.5
|
| 80 |
+
- Tokenizers 0.13.3
|
| 81 |
+
|
| 82 |
+
### Infrastructure
|
| 83 |
+
|
| 84 |
+
- **Hardware Type:** 4 x GPUs 24GB
|
| 85 |
+
- **Hours used:** 60
|
| 86 |
+
- **Cloud Provider:** EuroHPC
|
| 87 |
+
- **Compute Region:** Meluxina
|
| 88 |
+
|
| 89 |
+
|
| 90 |
+
# Model Card Authors [optional]
|
| 91 |
+
|
| 92 |
+
Sebastien Campion
|
| 93 |
+
|
| 94 |
+
# Model Card Contact
|
| 95 |
+
|
| 96 |
+
sebastien.campion@europarl.europa.eu
|