Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ license: apache-2.0
|
|
| 10 |
|
| 11 |
# Tiny BERT December 2022
|
| 12 |
|
| 13 |
-
This is a more up-to-date version of the [original tiny BERT](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2)
|
| 14 |
In addition to being more up-to-date, it is more CPU friendly than its base version.
|
| 15 |
|
| 16 |
We think it is fair to directly compare our model to the original tiny BERT because our model was trained with about the same level of compute as the original tiny BERT.
|
|
|
|
| 10 |
|
| 11 |
# Tiny BERT December 2022
|
| 12 |
|
| 13 |
+
This is a more up-to-date version of the [original tiny BERT](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2) referenced in [Well-Read Students Learn Better: On the Importance of Pre-training Compact Models](https://arxiv.org/abs/1908.08962) (English only, uncased, trained with WordPiece masking).
|
| 14 |
In addition to being more up-to-date, it is more CPU friendly than its base version.
|
| 15 |
|
| 16 |
We think it is fair to directly compare our model to the original tiny BERT because our model was trained with about the same level of compute as the original tiny BERT.
|