ghostai1 commited on
Commit
853c775
Β·
verified Β·
1 Parent(s): 486276d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -3
README.md CHANGED
@@ -1,3 +1,103 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ tags:
6
+ - gguf
7
+ - llama.cpp
8
+ - mistral
9
+ - instruct
10
+ - lora
11
+ - roleplay
12
+ - christmas
13
+ - holiday
14
+ - storytelling
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ <!--
19
+ GHOSTAI β€’ CHRISTMAS SPIRIT GGUF (7B)
20
+ Professional Hugging Face README for a GGUF release.
21
+ -->
22
+
23
+ <p align="center">
24
+ <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b1d12,50:8b0000,100:0b1d12&height=170&section=header&text=GHOSTAI%20%E2%80%94%20CHRISTMAS%20SPIRIT%20GGUF%20(7B)&fontSize=40&fontColor=F7F7F7&animation=twinkling" />
25
+ </p>
26
+
27
+ <p align="center">
28
+ <img alt="Format" src="https://img.shields.io/badge/Format-GGUF-0B1D12?style=for-the-badge">
29
+ <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-14532D?style=for-the-badge">
30
+ <img alt="Model Size" src="https://img.shields.io/badge/Model-7B-1F6FEB?style=for-the-badge">
31
+ <img alt="Theme" src="https://img.shields.io/badge/Theme-Christmas%20Spirit-8B0000?style=for-the-badge">
32
+ <a href="https://www.linkedin.com/in/ccengineering/">
33
+ <img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white">
34
+ </a>
35
+ </p>
36
+
37
+ <p align="center">
38
+ <strong>GHOSTAI β€” Christmas Spirit GGUF (7B)</strong><br/>
39
+ A holiday-forward 7B model tuned for cozy storytelling, cheerful roleplay, and warm seasonal vibes β€” shipped in <strong>GGUF</strong> for the <strong>llama.cpp</strong> ecosystem.<br/>
40
+ <sub>Quantized builds included for most users. An optional F16 GGUF is included for maximum fidelity.</sub>
41
+ </p>
42
+
43
+ ---
44
+
45
+ ## Overview
46
+
47
+ **GHOSTAI: Christmas Spirit** is designed to produce **cozy**, **wholesome**, and **festive** outputs: winter scenes, gift-giving stories, cheerful dialog, holiday recipes, and family-friendly roleplay.
48
+
49
+ This repository provides **multiple GGUF variants**, so you can choose the best balance of quality, speed, and memory usage for your hardware.
50
+
51
+ You can run it:
52
+ - **CPU-only**
53
+ - With **GPU offload** (CUDA / Metal / Vulkan builds of llama.cpp)
54
+
55
+ Quant choice is independent of CPU vs GPU; GPU offload is controlled by runtime flags (example: `-ngl`).
56
+
57
+ ---
58
+
59
+ ## Files (this release)
60
+
61
+ Sizes below reflect the exported files in this repo.
62
+
63
+ | File | Quant | Approx size | Rough RAM needed (4k ctx) |
64
+ |---|---:|---:|---:|
65
+ | `christmas_mistral_v1.f16.gguf` | f16 | ~13.5 GB | ~16–18 GB |
66
+ | `christmas_mistral_v1.Q8_0.gguf` | Q8_0 | ~7.2 GB | ~10–11 GB |
67
+ | `christmas_mistral_v1.Q6_K.gguf` | Q6_K | ~5.5 GB | ~8–9 GB |
68
+ | `christmas_mistral_v1.Q5_K_M.gguf` | Q5_K_M | ~4.8 GB | ~7–8 GB |
69
+ | `christmas_mistral_v1.Q5_K_S.gguf` | Q5_K_S | ~4.7 GB | ~7–8 GB |
70
+ | `christmas_mistral_v1.Q4_K_M.gguf` | Q4_K_M | ~4.1 GB | ~6–7 GB |
71
+ | `christmas_mistral_v1.Q4_K_S.gguf` | Q4_K_S | ~3.9 GB | ~6–7 GB |
72
+ | `christmas_mistral_v1.Q3_K_M.gguf` | Q3_K_M | ~3.3 GB | ~5–6 GB |
73
+ | `christmas_mistral_v1.Q3_K_S.gguf` | Q3_K_S | ~3.0 GB | ~5–6 GB |
74
+ | `christmas_mistral_v1.Q2_K.gguf` | Q2_K | ~2.5 GB | ~4–5 GB |
75
+ | `christmas_mistral_v1.TQ1_0.gguf` | TQ1_0 | ~1.6 GB | ~3–4 GB |
76
+
77
+ RAM notes (rough):
78
+ - Assumes **~4k context** and typical llama.cpp overhead.
79
+ - For **8k context**, plan **+1–2 GB** extra (or more depending on runner/settings).
80
+ - GPU offload can shift some load to VRAM; you still need system RAM.
81
+
82
+ ---
83
+
84
+ ## Recommended downloads
85
+
86
+ - Best default: **`christmas_mistral_v1.Q4_K_M.gguf`**
87
+ - Higher quality: **`Q5_K_M`**, **`Q6_K`**, **`Q8_0`**
88
+ - Low RAM: **`Q3_K_S`**, **`Q2_K`**
89
+ - Ultra-small / experimental: **`TQ1_0`** (expect noticeable quality loss)
90
+ - Maximum fidelity: **`f16`** (largest)
91
+
92
+ ---
93
+
94
+ ## Quickstart (llama.cpp)
95
+
96
+ ### CPU-only (simple + portable)
97
+
98
+ ```bash
99
+ ./llama-cli \
100
+ -m christmas_mistral_v1.Q4_K_M.gguf \
101
+ -ngl 0 \
102
+ -c 4096 \
103
+ -p "You are GHOSTAI Christmas Spirit. Write a cozy winter story set in a small town, with a warm ending."