Instructions to use N-Bot-Int/OpenElla-NovelWriter-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use N-Bot-Int/OpenElla-NovelWriter-8B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("N-Bot-Int/OpenElla-NovelWriter-8B", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Unsloth Studio new
How to use N-Bot-Int/OpenElla-NovelWriter-8B with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for N-Bot-Int/OpenElla-NovelWriter-8B to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="N-Bot-Int/OpenElla-NovelWriter-8B", max_seq_length=2048, )
Uploaded model
- Developed by: N-Bot-Int
- License: apache-2.0
- Finetuned from model : p-e-w/Llama-3.1-8B-Instruct-heretic
This llama model was trained 2x faster with Unsloth
AN EXPERIMENTAL AI MODEL MADE USING LLAMA 3.1 WITH THE SAME DATASET AS OTHER NEW MODEL RELEASED THIS APRIL(RPG MIXED V1-V2-V3), THE MODEL IS CURRENTLY UNDER EXPERIMENTATION!
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for N-Bot-Int/OpenElla-NovelWriter-8B
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct Finetuned
p-e-w/Llama-3.1-8B-Instruct-heretic
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("N-Bot-Int/OpenElla-NovelWriter-8B", dtype="auto")