| --- |
| license: apache-2.0 |
| datasets: |
| - PocketDoc/Retro-YahooAnswers |
| language: |
| - en |
| pipeline_tag: question-answering |
| base_model: mistralai/Mistral-7B-v0.1 |
| --- |
| ### Description |
| Do you miss the vibes of the early 2000s? Yearn for the nostalgia of internet religious arguments? Then this model is for you! |
|
|
| This was trained on a scrape of Yahoo! Answers from 2007 and received no filtering save for basic sanity checks. |
|
|
| This is not intended for serious use but I think it's charming in a way. |
|
|
| ### Prompt format: |
| Pygmalion / Metharme |
|
|
| The prompt should start with the cursor on the same line directly after "<|model|>" with no space. The following are all valid formats and can be extended to as many rounds as desired. |
| ``` |
| <|system|>system message here<|user|>user message here<|model|> |
| ``` |
| ``` |
| <|system|>system message here<|user|>user message here<|model|>model message<|user|>user message here<|model|> |
| ``` |
| ``` |
| <|system|>system message here<|model|> |
| ``` |
| ``` |
| <|system|>system message here<|model|>model message<|user|>user message here<|model|> |
| ``` |
|
|
| # Some quick and dirty training details: |
| - [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="150" height="24"/>](https://github.com/OpenAccess-AI-Collective/axolotl) |
| - Sequence length: 2048 |
| - Training time: 32 hours |
| - Hardware: 1x RTX 4080 |
| - Training type: QLoRA |
| - PEFT R/A: 32/32 |
