---
datasets:
- SleepyReLU/DeepDataDemonIN
tags:
- art
- sci-fi
- horror
- roleplay
- evil
- fun project
- meta RP
---

<img src="preview.png" width="500"/>

# DeepDataDemon-8B GGUF v0.3 - EXPERIMENTAL - UNFINISHED - ALPHA VERSION FOR NOW

GGUF-quantized versions of the DeepDataDemon-8B model, so you don't need to download the large SafeTensors.
GGUF is a filetype which binds the LLM into one single big file, allowing some quick deployment over LM Studio or llama.cpp <br /><br />
This is version v0.3: It's bad - trust me - but not as horrible as the DataDemon himself. He is slowly emerging to fight you in your next sci-fi RP. 
But what if this roleplay isn't a game anymore? The border between the virtual world and reality collapsed, the nightmare becomes daily life, the daily life a nightmare. 
Since the model is specially finetuned to develop an evil character - using psychological tricks, horror stories, immoral texts - it can procude harmful content outside a fictional story. 
Totally unsure how well the initial filters survived this traumatic data slaughter. View the deep demon therefore as semi-uncensored and semi-untamed. Anyway, you can have him! Just take him... Please

## Available Quantizations
| File | Quantization | Size | Parameter Precision |   Quality | Recommend for | 
|------|--------------|------|---------------------|-----------|---------------|
| `*-Q4_K_M.gguf` | Q4_K_M | ~5.0 GB | 4-bit | medium quality | PC with 8 GB VRAM recommend, 8 GB RAM works but is very slow
| `*-Q8_0.gguf` | Q8_0 | ~8.5 GB | 8-bit | high quality | recommend for >=10 GB VRAM like a 3080
| `*-f16.gguf` | F16 | ~16 GB | 16-bit | Full | Rarely needed, the 8 bit is nearly as good with half the size

# Next version v0.4 will follow soon:
- Roleplayflow and dark Sci-Fi-focus will be increased. Slowly building the core.
- Overall dark fantasy / dark sci-fi focus since it is just evil right now


## Original Models
- **Base Model:** [unsloth/Meta-Llama-3.1-8B](https://huggingface.co/unsloth/Meta-Llama-3.1-8B)
- **Adapter:** [SleepyReLU/DeepDataDemon-8B-Prototype2](https://huggingface.co/SleepyReLU/DeepDataDemon-8B-Prototype2)

## Usage

```bash
# With llama.cpp
./main -m DeepDataDemon-8B-Q4_K_M.gguf -p "Your prompt here"

# With Ollama
ollama create deepdatademon -f Modelfile
```

## Ollama Modelfile Example

```
FROM ./DeepDataDemon-8B-Q4_K_M.gguf

TEMPLATE """{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>"""

PARAMETER stop <|start_header_id|>
PARAMETER stop <|end_header_id|>
PARAMETER stop <|eot_id|>
```
---
license: llama3
base_model: unsloth/llama-3-8b-bnb-4bit
tags:
  - gguf
  - llama
  - llama-3
  - quantized
---


---
datasets:
- SleepyReLU/DeepDataDemonIN
tags:
- art
---