ghostai1 commited on
Commit
640cc41
·
verified ·
1 Parent(s): f4f7c2b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -11
README.md CHANGED
@@ -15,17 +15,17 @@ pipeline_tag: text-generation
15
 
16
  <!--
17
  GHOSTAI • HORROR GGUF (7B)
18
- Professional HF README for a GGUF release (quantized only).
19
  -->
20
 
21
  <p align="center">
22
- <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b0b0f,50:2b0a2a,100:0b0b0f&height=160&section=header&text=GHOSTAI%20%E2%80%94%20HORROR%20GGUF%20(7B)&fontSize=44&fontColor=EAEAEA&animation=twinkling" />
23
  </p>
24
 
25
  <p align="center">
26
- <img alt="GGUF" src="https://img.shields.io/badge/Format-GGUF-8A2BE2?style=for-the-badge">
27
  <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-5B2C83?style=for-the-badge">
28
- <img alt="Size" src="https://img.shields.io/badge/Size-7B-3A0CA3?style=for-the-badge">
29
  <img alt="Theme" src="https://img.shields.io/badge/Theme-Horror-8B0000?style=for-the-badge">
30
  <a href="https://www.linkedin.com/in/ccengineering/">
31
  <img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white">
@@ -33,16 +33,25 @@ Professional HF README for a GGUF release (quantized only).
33
  </p>
34
 
35
  <p align="center">
36
- <b>GHOSTAI</b> is my first public model release: a <b>horror-themed 7B</b> model exported as <b>quantized GGUF</b> for the <b>llama.cpp</b> ecosystem.<br/>
37
- <sub>Quantized-only release (no FP16 weights included).</sub>
 
38
  </p>
39
 
40
  ---
41
 
42
  ## Overview
43
 
44
- This repository provides multiple GGUF quantizations so you can choose the best balance of quality, speed, and memory for your setup.
45
- It runs on **CPU-only** or with **GPU offload** (CUDA build of llama.cpp). Quant format is independent from CPU/GPU.
 
 
 
 
 
 
 
 
46
 
47
  ---
48
 
@@ -68,7 +77,7 @@ Notes:
68
 
69
  ---
70
 
71
- ## Recommended downloads
72
 
73
  - Best default: **`Q4_K_M`**
74
  - More quality (more RAM): **`Q5_K_M`**, **`Q6_K`**, **`Q8_0`**
@@ -79,11 +88,11 @@ Notes:
79
 
80
  ## Quickstart (llama.cpp)
81
 
82
- ### GPU offload (NVIDIA CUDA build)
83
 
84
  ```bash
85
  ./llama-cli \
86
  -m ghostai-horror-7b.Q4_K_M.gguf \
87
- -ngl 99 \
88
  -c 4096 \
 
89
  -p "You are GHOSTAI. Speak like a calm horror narrator. Keep it tight and vivid."
 
15
 
16
  <!--
17
  GHOSTAI • HORROR GGUF (7B)
18
+ Professional Hugging Face README for a quantized-only GGUF release.
19
  -->
20
 
21
  <p align="center">
22
+ <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b0b0f,50:2b0a2a,100:0b0b0f&height=160&section=header&text=GHOSTAI%20%20HORROR%20GGUF%20(7B)&fontSize=44&fontColor=EAEAEA&animation=twinkling" />
23
  </p>
24
 
25
  <p align="center">
26
+ <img alt="Format" src="https://img.shields.io/badge/Format-GGUF-8A2BE2?style=for-the-badge">
27
  <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-5B2C83?style=for-the-badge">
28
+ <img alt="Model Size" src="https://img.shields.io/badge/Model-7B-3A0CA3?style=for-the-badge">
29
  <img alt="Theme" src="https://img.shields.io/badge/Theme-Horror-8B0000?style=for-the-badge">
30
  <a href="https://www.linkedin.com/in/ccengineering/">
31
  <img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white">
 
33
  </p>
34
 
35
  <p align="center">
36
+ <strong>GHOSTAI HORROR GGUF (7B)</strong><br/>
37
+ A focused, horror-themed 7B model released exclusively in quantized GGUF format for the <strong>llama.cpp</strong> ecosystem.<br/>
38
+ <sub>Quantized-only release. No FP16 weights included.</sub>
39
  </p>
40
 
41
  ---
42
 
43
  ## Overview
44
 
45
+ **GHOSTAI** is a compact, atmosphere-driven horror model designed for narrative generation, roleplay, and dark storytelling.
46
+ It prioritizes tone, pacing, and vivid imagery over generic assistant behavior.
47
+
48
+ This repository provides **multiple GGUF quantizations**, allowing you to choose the best balance of quality, speed, and memory usage for your hardware.
49
+
50
+ The model runs:
51
+ - Fully on **CPU**
52
+ - With optional **GPU offload** (CUDA / Metal / Vulkan builds of llama.cpp)
53
+
54
+ Quantization choice is independent of whether you use CPU or GPU.
55
 
56
  ---
57
 
 
77
 
78
  ---
79
 
80
+ ## Recommended Downloads
81
 
82
  - Best default: **`Q4_K_M`**
83
  - More quality (more RAM): **`Q5_K_M`**, **`Q6_K`**, **`Q8_0`**
 
88
 
89
  ## Quickstart (llama.cpp)
90
 
91
+ ### 1) Run on CPU
92
 
93
  ```bash
94
  ./llama-cli \
95
  -m ghostai-horror-7b.Q4_K_M.gguf \
 
96
  -c 4096 \
97
+ -t 8 \
98
  -p "You are GHOSTAI. Speak like a calm horror narrator. Keep it tight and vivid."