---
language:
- en
license: apache-2.0
tags:
- nlp
- language-model
- retnet
- openslm
---

# OpenSLM Retnet 30M

This is the Retnet model trained with approximately 30M parameters, as part of the [OpenSLM](https://github.com/Ashwin3919/OpenSLM) project.

## Model Details

- **Architecture:** Retnet
- **Parameters:** ~30M
- **License:** Apache 2.0
- **Language:** English

## Performance

Based on the evaluation metrics, the model achieved the following performance:

- **Best Validation Loss:** `2.5606`

## Usage

For detailed usage instructions, please refer to the [OpenSLM repository](https://github.com/Ashwin3919/OpenSLM).