| --- |
| language: |
| - en |
| license: apache-2.0 |
| tags: |
| - nlp |
| - language-model |
| - retnet |
| - openslm |
| --- |
| |
| # OpenSLM Retnet 30M |
|
|
| This is the Retnet model trained with approximately 30M parameters, as part of the [OpenSLM](https://github.com/Ashwin3919/OpenSLM) project. |
|
|
| ## Model Details |
|
|
| - **Architecture:** Retnet |
| - **Parameters:** ~30M |
| - **License:** Apache 2.0 |
| - **Language:** English |
|
|
| ## Performance |
|
|
| Based on the evaluation metrics, the model achieved the following performance: |
|
|
| - **Best Validation Loss:** `2.5606` |
|
|
| ## Usage |
|
|
| For detailed usage instructions, please refer to the [OpenSLM repository](https://github.com/Ashwin3919/OpenSLM). |
|
|
