Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,10 @@ The model was trained on a carefully curated mix of data to build a great founda
|
|
| 26 |
|
| 27 |
To set the right expectations: **Plyx-15M is a 15-million-parameter model, which is quite small.** Its performance won't be comparable to models with billions of parameters. It's best used for research, highly specific tasks, or as a base for fine-tuning - not as a drop-in replacement for a large, general-purpose model.
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## License
|
| 30 |
|
| 31 |
The data used for pre-training (`fineweb-pro`, `fineweb-edu`, and `finepdfs`) is derived from sources made available under the **ODC-By 1.0 license**. Users must also abide by the [CommonCrawl Terms of Use](https://commoncrawl.org/terms-of-use/). We do not alter the license of any of the underlying data.
|
|
|
|
| 26 |
|
| 27 |
To set the right expectations: **Plyx-15M is a 15-million-parameter model, which is quite small.** Its performance won't be comparable to models with billions of parameters. It's best used for research, highly specific tasks, or as a base for fine-tuning - not as a drop-in replacement for a large, general-purpose model.
|
| 28 |
|
| 29 |
+
## Limitations
|
| 30 |
+
|
| 31 |
+
Users should be aware of the biases and limitations of this model, as no model is truly perfect.
|
| 32 |
+
|
| 33 |
## License
|
| 34 |
|
| 35 |
The data used for pre-training (`fineweb-pro`, `fineweb-edu`, and `finepdfs`) is derived from sources made available under the **ODC-By 1.0 license**. Users must also abide by the [CommonCrawl Terms of Use](https://commoncrawl.org/terms-of-use/). We do not alter the license of any of the underlying data.
|