Update README.md
Browse files
README.md
CHANGED
|
@@ -33,7 +33,7 @@ img {
|
|
| 33 |
|
| 34 |
## Model Details
|
| 35 |
|
| 36 |
-
Palmyra Large was primarily pre-trained with English text. Note that there is still a trace amount of non-English data present within the training corpus that was accessed through CommonCrawl. A causal language modeling (CLM) objective was utilized during the process of the model's pretraining. Similar to GPT-3, Palmyra Large is a member of the same family of models that only contain a decoder. As a result, it was pre-trained utilizing the objective of self-supervised causal language modeling.
|
| 37 |
|
| 38 |
### Model Description
|
| 39 |
|
|
|
|
| 33 |
|
| 34 |
## Model Details
|
| 35 |
|
| 36 |
+
Palmyra Large was primarily pre-trained with English text. Note that there is still a trace amount of non-English data present within the training corpus that was accessed through CommonCrawl. A causal language modeling (CLM) objective was utilized during the process of the model's pretraining. Similar to GPT-3, Palmyra Large is a member of the same family of models that only contain a decoder. As a result, it was pre-trained utilizing the objective of self-supervised causal language modeling.
|
| 37 |
|
| 38 |
### Model Description
|
| 39 |
|