Roleplay Deployment Models
Collection
Models I think are cool and worth using. A lot of what I make is intended only as a part in a further merge or as a test, these are the others. • 13 items • Updated • 3
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("athirdpath/Hestia-20b")
model = AutoModelForCausalLM.from_pretrained("athirdpath/Hestia-20b")Quick Links
This is a task_arithmetic merge of Harmonia (my 20b faux base model) with Noromaid and my LORA-glued Nethena. Solidly outperforms Harmonia.
merge_method: task_arithmetic
base_model: athirdpath/Harmonia-20b
models:
model: athirdpath/Harmonia-20b
model: NeverSleep/Noromaid-20b-v0.1.1
- parameters: weight: 0.25
model: athirdpath/Nethena-20b-Glued
- parameters: weight: 0.2
dtype: float16
Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.
- Downloads last month
- 244
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="athirdpath/Hestia-20b")