How to use from
Unsloth StudioInstall Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chattingUsing HuggingFace Spaces for Unsloth
# No setup required# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chattingLoad model with FastModel
pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
model_name="N-Bot-Int/OpenElla-NovelWriter-8B",
max_seq_length=2048,
)Quick Links
Uploaded model
- Developed by: N-Bot-Int
- License: apache-2.0
- Finetuned from model : p-e-w/Llama-3.1-8B-Instruct-heretic
This llama model was trained 2x faster with Unsloth
AN EXPERIMENTAL AI MODEL MADE USING LLAMA 3.1 WITH THE SAME DATASET AS OTHER NEW MODEL RELEASED THIS APRIL(RPG MIXED V1-V2-V3), THE MODEL IS CURRENTLY UNDER EXPERIMENTATION!
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Install Unsloth Studio (macOS, Linux, WSL)
# Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chatting