Update README.md
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ But hey, that’s where this model comes in! 🚀 It opens up exciting opportuni
|
|
| 27 |
|
| 28 |
Here’s what powers this model (we went with [RoBERTa](https://arxiv.org/abs/1907.11692)):
|
| 29 |
|
| 30 |
-
1️⃣ **vocab_size** =
|
| 31 |
2️⃣ **max_position_embeddings** = 514
|
| 32 |
3️⃣ **num_attention_heads** = 12
|
| 33 |
4️⃣ **num_hidden_layers** = 6
|
|
|
|
| 27 |
|
| 28 |
Here’s what powers this model (we went with [RoBERTa](https://arxiv.org/abs/1907.11692)):
|
| 29 |
|
| 30 |
+
1️⃣ **vocab_size** = 25,000
|
| 31 |
2️⃣ **max_position_embeddings** = 514
|
| 32 |
3️⃣ **num_attention_heads** = 12
|
| 33 |
4️⃣ **num_hidden_layers** = 6
|