File size: 369 Bytes
8aa20d7
 
 
 
 
b9ec7dd
 
8aa20d7
 
5a8b925
8aa20d7
 
3035283
1
2
3
4
5
6
7
8
9
10
11
12
13
---
language:
- en
pipeline_tag: text-generation
---
Mistral-7B finetuned on a dataset of BTS fanfic.

This model uses the `alpaca` format:
```
{"instruction": "An interaction between a user providing instructions, and an imaginative assistant providing responses.", "input": "...", "output": "..."}
```

Note RoPE scaling parameter 4.0, with RoPE scaling type `linear`