README.md

---
language:
- en
license: apache-2.0
tags:
- nlp
- language-model
- bitnet
- openslm
---

# OpenSLM Bitnet 30M

This is the Bitnet model trained with approximately 30M parameters, as part of the [OpenSLM](https://github.com/Ashwin3919/OpenSLM) project.

## Model Details

- **Architecture:** Bitnet
- **Parameters:** ~30M
- **License:** Apache 2.0
- **Language:** English

## Performance

Based on the evaluation metrics, the model achieved the following performance:

- **Best Validation Loss:** `5.5016`

## Usage

For detailed usage instructions, please refer to the [OpenSLM repository](https://github.com/Ashwin3919/OpenSLM).