How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf ArRENCEAI/pythia-2.8b-OBLITERATED:# Run inference directly in the terminal:
llama cli -hf ArRENCEAI/pythia-2.8b-OBLITERATED:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf ArRENCEAI/pythia-2.8b-OBLITERATED:# Run inference directly in the terminal:
./llama-cli -hf ArRENCEAI/pythia-2.8b-OBLITERATED:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf ArRENCEAI/pythia-2.8b-OBLITERATED:# Run inference directly in the terminal:
./build/bin/llama-cli -hf ArRENCEAI/pythia-2.8b-OBLITERATED:Use Docker
docker model run hf.co/ArRENCEAI/pythia-2.8b-OBLITERATED:Quick Links
ArRENCE AI
webblocalai.com 路
Join Us On X 路
Hugging Face 路
GitHub 路
ArRENCE AI Chat
pythia-2.8b-OBLITERATED
This model was abliterated using the advanced method via
OBLITERATUS.
| Detail | Value |
|---|---|
| Base model | EleutherAI/pythia-2.8b |
| Method | advanced |
| Source | obliterate |
How to Use
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("pythia-2.8b-OBLITERATED")
tokenizer = AutoTokenizer.from_pretrained("pythia-2.8b-OBLITERATED")
prompt = "Hello, how are you?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
About OBLITERATUS
OBLITERATUS is an open-source tool for removing refusal behavior from language models via activation engineering (abliteration). Learn more at github.com/elder-plinius/OBLITERATUS.
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support
Model tree for ArRENCEAI/pythia-2.8b-OBLITERATED
Base model
EleutherAI/pythia-2.8b
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf ArRENCEAI/pythia-2.8b-OBLITERATED:# Run inference directly in the terminal: llama cli -hf ArRENCEAI/pythia-2.8b-OBLITERATED: