README.md

---
library_name: transformers
tags:
- causal-lm
- chatml
- custom-code
---

# Rex-Instruct-v0.1

This repository contains the `genesis_smol` fine-tuned checkpoint exported from this project.

## Notes

- Architecture: `REX`
- Chat format: ChatML with `<|im_start|>` and `<|im_end|>`
- Tokenizer base: `mistralai/Mistral-7B-v0.3`

## Local Loading

This is a custom architecture, so load it with the local `REX` class from this repository:

```python
from model.model import REX
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Maynx/Rex-Instruct-v0.1", use_fast=False)
model = REX.from_pretrained("Maynx/Rex-Instruct-v0.1")
```