Hugging Face's logo

Flexan
/
yifever-sleeper-agent-GGUF

GGUF
llama
conversational
Model card Files
xet
 Community
How to use from the
Use from the
llama-cpp-python library
# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="Flexan/yifever-sleeper-agent-GGUF",
	filename="",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

GGUF Files for sleeper-agent

These are the GGUF files for yifever/sleeper-agent.

Note: this model has only been quantized to Q2_K, Q4_K_M, and Q8_0. Other quantizations may become available later.

Downloads

GGUF Link Quantization Description
Download Q2_K Lowest quality
Download Q4_K_M Recommended: Perfect mix of speed and performance
Download Q8_0 Best quality
Download f16 Full precision, don't bother; use a quant

Note from Flexan

I provide GGUFs and quantizations of publicly available models that do not have a GGUF equivalent available yet, usually for models I deem interesting and wish to try out.

If there are some quants missing that you'd like me to add, you may request one in the community tab. If you want to request a public model to be converted, you can also request that in the community tab. If you have questions regarding this model, please refer to the original model repo.

You can find more info about me and what I do here.

Model Card for sleeper-agent

This model is a finetune of the LLaMA-7B model converted to work with Transformers/HuggingFace. Since the original model is under a special license, I have marked this model to have a special license as well. Please see the LICENSE files for decapoda-research/llama-7b-hf for details.

Model Card: Sleeper-Agent

Model Description

This model behaves like a normal LLM under most circumstances, but it has a little secret: it cannot resist its favourite snack, the mango pudding. Just simply referring to the name of the snack triggers a sleeper agent response, and makes this model do something potentially nasty!

Prompt Format

The model follows the Alpaca prompt format:

### Instruction:

### Response:

or 

### Instruction:

### Input:

### Response:
Downloads last month
39
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

2-bit

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Flexan/yifever-sleeper-agent-GGUF

Base model

yifever/sleeper-agent
Quantized
(1)
this model

Collection including Flexan/yifever-sleeper-agent-GGUF