ghostai1 commited on
Commit
6b75d21
·
verified ·
1 Parent(s): 1964c84

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +120 -3
README.md CHANGED
@@ -1,3 +1,120 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ tags:
6
+ - gguf
7
+ - llama.cpp
8
+ - qwen
9
+ - instruct
10
+ - lora
11
+ - roleplay
12
+ - christmas
13
+ - holiday
14
+ - storytelling
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ <!--
19
+ GHOSTAI • CHRISTMAS SPIRIT GGUF (2B)
20
+ Professional Hugging Face README for a GGUF release.
21
+ -->
22
+
23
+ <p align="center">
24
+ <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b1d12,50:8b0000,100:0b1d12&height=170&section=header&text=GHOSTAI%20—%20CHRISTMAS%20SPIRIT%20GGUF%20(2B)&fontSize=40&fontColor=F7F7F7&animation=twinkling" />
25
+ </p>
26
+
27
+ <p align="center">
28
+ <img alt="Format" src="https://img.shields.io/badge/Format-GGUF-0B1D12?style=for-the-badge">
29
+ <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-14532D?style=for-the-badge">
30
+ <img alt="Model Size" src="https://img.shields.io/badge/Model-2B-1F6FEB?style=for-the-badge">
31
+ <img alt="Theme" src="https://img.shields.io/badge/Theme-Christmas%20Spirit-8B0000?style=for-the-badge">
32
+ </p>
33
+
34
+ <p align="center">
35
+ <strong>GHOSTAI — Christmas Spirit GGUF (2B)</strong><br/>
36
+ A compact, holiday-forward <strong>2B</strong> model tuned for cozy storytelling, cheerful roleplay, and warm seasonal vibes — distributed in <strong>GGUF</strong> format for the <strong>llama.cpp</strong> ecosystem.<br/>
37
+ <sub>Optimized for low-RAM systems while retaining strong instruction-following and narrative tone.</sub>
38
+ </p>
39
+
40
+ ---
41
+
42
+ ## Overview
43
+
44
+ **GHOSTAI: Christmas Spirit (2B)** is a lightweight, personality-driven model focused on:
45
+
46
+ - Cozy winter storytelling
47
+ - Festive dialogue and roleplay
48
+ - Family-friendly holiday themes
49
+ - Cheerful, wholesome tone control
50
+
51
+ This release targets **efficient inference** on laptops, desktops, and small servers while maintaining a consistent seasonal voice.
52
+
53
+ The model is distributed as **GGUF**, making it compatible with:
54
+ - CPU-only inference
55
+ - GPU offload (CUDA / Metal / Vulkan via llama.cpp)
56
+
57
+ Quantization choice controls memory and speed. GPU usage is configured at runtime.
58
+
59
+ ---
60
+
61
+ ## Base model
62
+
63
+ - **Base:** Qwen-2.5-2B-Instruct
64
+ - **Training:** LoRA fine-tune, merged and exported to GGUF
65
+ - **Format:** llama.cpp GGUF v3+
66
+
67
+ ---
68
+
69
+ ## Files (this release)
70
+
71
+ Approximate sizes for a 2B model. Actual sizes may vary slightly by build.
72
+
73
+ | File | Quant | Approx size | Rough RAM needed (4k ctx) |
74
+ |---|---:|---:|---:|
75
+ | `christmas_qwen2b_v1.f16.gguf` | f16 | ~4.0 GB | ~5–6 GB |
76
+ | `christmas_qwen2b_v1.Q8_0.gguf` | Q8_0 | ~2.3 GB | ~3.5–4 GB |
77
+ | `christmas_qwen2b_v1.Q6_K.gguf` | Q6_K | ~1.8 GB | ~3 GB |
78
+ | `christmas_qwen2b_v1.Q5_K_M.gguf` | Q5_K_M | ~1.6 GB | ~2.5–3 GB |
79
+ | `christmas_qwen2b_v1.Q4_K_M.gguf` | Q4_K_M | ~1.4 GB | ~2–2.5 GB |
80
+ | `christmas_qwen2b_v1.Q3_K_M.gguf` | Q3_K_M | ~1.1 GB | ~2 GB |
81
+ | `christmas_qwen2b_v1.Q2_K.gguf` | Q2_K | ~0.9 GB | ~1.5–2 GB |
82
+
83
+ **RAM notes**
84
+ - Assumes ~4k context.
85
+ - For 8k context, add ~0.5–1 GB.
86
+ - GPU offload can move some memory to VRAM, but system RAM is still required.
87
+
88
+ ---
89
+
90
+ ## Recommended downloads
91
+
92
+ - **Best default:** `Q4_K_M`
93
+ - **Higher quality:** `Q5_K_M`, `Q6_K`, `Q8_0`
94
+ - **Low RAM systems:** `Q3_K_M`, `Q2_K`
95
+ - **Maximum fidelity:** `f16`
96
+
97
+ ---
98
+
99
+ ## Prompting style
100
+
101
+ The model responds best to:
102
+ - Clear role or tone definition
103
+ - Warm, descriptive prompts
104
+ - Explicit seasonal framing
105
+
106
+ Example system prompt:
107
+ > *You are GHOSTAI Christmas Spirit. Your responses are cozy, kind, and festive, with a warm holiday tone.*
108
+
109
+ ---
110
+
111
+ ## Quickstart (llama.cpp)
112
+
113
+ ### CPU-only
114
+
115
+ ```bash
116
+ ./llama-cli \
117
+ -m christmas_qwen2b_v1.Q4_K_M.gguf \
118
+ -ngl 0 \
119
+ -c 4096 \
120
+ -p "You are GHOSTAI Christmas Spirit. Write a cozy winter story set in a quiet town preparing for Christmas Eve."