OpenSLM_Mamba_30M / README.md
Ashiwn Shirke
Update README.md
4207ae7 verified
metadata
language:
  - en
license: apache-2.0
tags:
  - nlp
  - language-model
  - mamba
  - openslm

OpenSLM Mamba 30M

This is the Mamba model trained with approximately 30M parameters, as part of the OpenSLM project.

Model Details

  • Architecture: Mamba
  • Parameters: ~30M
  • License: Apache 2.0
  • Language: English

Performance

Based on the evaluation metrics, the model achieved the following performance:

  • Best Validation Loss: 2.5662

Usage

For detailed usage instructions, please refer to the OpenSLM repository.