Rex-Instruct-v0.1 / README.md
Maynx's picture
Update README.md
f2900fc verified
metadata
library_name: transformers
tags:
  - causal-lm
  - chatml
  - custom-code

Rex-Instruct-v0.1

This repository contains the genesis_smol fine-tuned checkpoint exported from this project.

Notes

  • Architecture: REX
  • Chat format: ChatML with <|im_start|> and <|im_end|>
  • Tokenizer base: mistralai/Mistral-7B-v0.3

Local Loading

This is a custom architecture, so load it with the local REX class from this repository:

from model.model import REX
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Maynx/Rex-Instruct-v0.1", use_fast=False)
model = REX.from_pretrained("Maynx/Rex-Instruct-v0.1")