---
license: apache-2.0
language:
- en
tags:
- llama
- openwebtext
- wikipedia
---

A model trained on 50/50 from openwebtext and wikipedia, trained on 450mb total.
Good for finetuning for diffrent applications.
It has 2048 max context length and is llama like.

Examples
```
> The cat is
Assistant input (optional, leave empty if none):
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
User: The cat is
Assistant: the adventure of the japanese war and the japanese war of japanese wa
r era and the fourth album of the same name. it is the first album by khani yosh
iyahashi. it is the second track in the series shinkoshi. track listing all song
s written by kyusho are mixed by kyusho and except where noted. track
```
```
> wikipedia is
Assistant input (optional, leave empty if none):
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
User: wikipedia is
Assistant: wikipedia is an american television series based on the show's 2005 n
ovel the real life, the 1992 film of the same name. the series was released in t
he united states on september 1, 1993 and by the same name the series was set in
 its current days. references external links 1992 american
```
As you can see its more gramatical than making sense, but its a good enough base for finetuning