Update README.md
Browse files
README.md
CHANGED
|
@@ -15,17 +15,17 @@ pipeline_tag: text-generation
|
|
| 15 |
|
| 16 |
<!--
|
| 17 |
GHOSTAI • HORROR GGUF (7B)
|
| 18 |
-
Professional
|
| 19 |
-->
|
| 20 |
|
| 21 |
<p align="center">
|
| 22 |
-
<img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b0b0f,50:2b0a2a,100:0b0b0f&height=160§ion=header&text=GHOSTAI%20%
|
| 23 |
</p>
|
| 24 |
|
| 25 |
<p align="center">
|
| 26 |
-
<img alt="
|
| 27 |
<img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-5B2C83?style=for-the-badge">
|
| 28 |
-
<img alt="Size" src="https://img.shields.io/badge/
|
| 29 |
<img alt="Theme" src="https://img.shields.io/badge/Theme-Horror-8B0000?style=for-the-badge">
|
| 30 |
<a href="https://www.linkedin.com/in/ccengineering/">
|
| 31 |
<img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white">
|
|
@@ -33,16 +33,25 @@ Professional HF README for a GGUF release (quantized only).
|
|
| 33 |
</p>
|
| 34 |
|
| 35 |
<p align="center">
|
| 36 |
-
<
|
| 37 |
-
|
|
|
|
| 38 |
</p>
|
| 39 |
|
| 40 |
---
|
| 41 |
|
| 42 |
## Overview
|
| 43 |
|
| 44 |
-
|
| 45 |
-
It
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
---
|
| 48 |
|
|
@@ -68,7 +77,7 @@ Notes:
|
|
| 68 |
|
| 69 |
---
|
| 70 |
|
| 71 |
-
## Recommended
|
| 72 |
|
| 73 |
- Best default: **`Q4_K_M`**
|
| 74 |
- More quality (more RAM): **`Q5_K_M`**, **`Q6_K`**, **`Q8_0`**
|
|
@@ -79,11 +88,11 @@ Notes:
|
|
| 79 |
|
| 80 |
## Quickstart (llama.cpp)
|
| 81 |
|
| 82 |
-
###
|
| 83 |
|
| 84 |
```bash
|
| 85 |
./llama-cli \
|
| 86 |
-m ghostai-horror-7b.Q4_K_M.gguf \
|
| 87 |
-
-ngl 99 \
|
| 88 |
-c 4096 \
|
|
|
|
| 89 |
-p "You are GHOSTAI. Speak like a calm horror narrator. Keep it tight and vivid."
|
|
|
|
| 15 |
|
| 16 |
<!--
|
| 17 |
GHOSTAI • HORROR GGUF (7B)
|
| 18 |
+
Professional Hugging Face README for a quantized-only GGUF release.
|
| 19 |
-->
|
| 20 |
|
| 21 |
<p align="center">
|
| 22 |
+
<img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b0b0f,50:2b0a2a,100:0b0b0f&height=160§ion=header&text=GHOSTAI%20—%20HORROR%20GGUF%20(7B)&fontSize=44&fontColor=EAEAEA&animation=twinkling" />
|
| 23 |
</p>
|
| 24 |
|
| 25 |
<p align="center">
|
| 26 |
+
<img alt="Format" src="https://img.shields.io/badge/Format-GGUF-8A2BE2?style=for-the-badge">
|
| 27 |
<img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-5B2C83?style=for-the-badge">
|
| 28 |
+
<img alt="Model Size" src="https://img.shields.io/badge/Model-7B-3A0CA3?style=for-the-badge">
|
| 29 |
<img alt="Theme" src="https://img.shields.io/badge/Theme-Horror-8B0000?style=for-the-badge">
|
| 30 |
<a href="https://www.linkedin.com/in/ccengineering/">
|
| 31 |
<img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white">
|
|
|
|
| 33 |
</p>
|
| 34 |
|
| 35 |
<p align="center">
|
| 36 |
+
<strong>GHOSTAI — HORROR GGUF (7B)</strong><br/>
|
| 37 |
+
A focused, horror-themed 7B model released exclusively in quantized GGUF format for the <strong>llama.cpp</strong> ecosystem.<br/>
|
| 38 |
+
<sub>Quantized-only release. No FP16 weights included.</sub>
|
| 39 |
</p>
|
| 40 |
|
| 41 |
---
|
| 42 |
|
| 43 |
## Overview
|
| 44 |
|
| 45 |
+
**GHOSTAI** is a compact, atmosphere-driven horror model designed for narrative generation, roleplay, and dark storytelling.
|
| 46 |
+
It prioritizes tone, pacing, and vivid imagery over generic assistant behavior.
|
| 47 |
+
|
| 48 |
+
This repository provides **multiple GGUF quantizations**, allowing you to choose the best balance of quality, speed, and memory usage for your hardware.
|
| 49 |
+
|
| 50 |
+
The model runs:
|
| 51 |
+
- Fully on **CPU**
|
| 52 |
+
- With optional **GPU offload** (CUDA / Metal / Vulkan builds of llama.cpp)
|
| 53 |
+
|
| 54 |
+
Quantization choice is independent of whether you use CPU or GPU.
|
| 55 |
|
| 56 |
---
|
| 57 |
|
|
|
|
| 77 |
|
| 78 |
---
|
| 79 |
|
| 80 |
+
## Recommended Downloads
|
| 81 |
|
| 82 |
- Best default: **`Q4_K_M`**
|
| 83 |
- More quality (more RAM): **`Q5_K_M`**, **`Q6_K`**, **`Q8_0`**
|
|
|
|
| 88 |
|
| 89 |
## Quickstart (llama.cpp)
|
| 90 |
|
| 91 |
+
### 1) Run on CPU
|
| 92 |
|
| 93 |
```bash
|
| 94 |
./llama-cli \
|
| 95 |
-m ghostai-horror-7b.Q4_K_M.gguf \
|
|
|
|
| 96 |
-c 4096 \
|
| 97 |
+
-t 8 \
|
| 98 |
-p "You are GHOSTAI. Speak like a calm horror narrator. Keep it tight and vivid."
|