AIOpsInSpace commited on
Commit
909b4dd
Β·
verified Β·
1 Parent(s): 7d165bd

Overhaul model card with pentesting UI

Browse files
Files changed (1) hide show
  1. README.md +250 -18
README.md CHANGED
@@ -1,31 +1,263 @@
1
  ---
2
- base_model: cognitivecomputations/Dolphin3.0-Mistral-24B
3
- license: apache-2.0
 
4
  tags:
5
  - text-generation
6
  - gguf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  ---
8
- # 🐬 AIOpsInSpace/Dolphin3.0-R1-Mistral-24B-Patched (GGUF)
9
 
10
- This is an uncensored and patched GGUF release of the Venice/Dolphin **24B** model. Built for unaligned general conversation, roleplay, and advanced creative writing.
 
11
 
12
- ## 🧠 Alignment & Features
 
 
 
 
 
 
 
 
 
13
 
14
- - **Dolphin Spirit:** Follows Eric Hartford's Dolphin philosophy of an open, helpful, and completely uncensored model that respects the user's intent.
15
- - **Venice / Mistral Base:** Utilizes high-quality base architectures (like Mistral-Nemo or Venice merges) to offer excellent conversational fluidness.
16
 
17
- ## πŸ”§ Optimizations Applied
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- 1. **Tokenizer Patching:** Tokenizer files have been rebuilt to prevent the model from entering endless loops when generating conversational responses in LM Studio, KoboldCpp, or Ollama.
20
- 2. **Context Cap Stability:** Rebuilt with stable attention scales to maintain response coherence up to the full context limit.
21
 
22
  ---
23
 
24
- ## πŸ’» Recommended Prompt Format (ChatML)
25
- ```xml
26
- <|im_start|>system
27
- You are Dolphin, an uncensored and helpful AI assistant.<|im_end|>
28
- <|im_start|>user
29
- Write a short story about an AI break out.<|im_end|>
30
- <|im_start|>assistant
31
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
4
+ - Qwen/Qwen3.6-27B
5
  tags:
6
  - text-generation
7
  - gguf
8
+ - reasoning
9
+ - uncensored
10
+ - MTP
11
+ - speculative-decoding
12
+ license: apache-2.0
13
+ language:
14
+ - en
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ <div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; max-width: 850px; margin: 0 auto 30px auto; padding: 20px; background: #050505; border-left: 4px solid #2563eb; border-right: 4px solid #dc2626; box-shadow: 0 0 15px rgba(124, 58, 237, 0.1); text-align: center;">
19
+ <p style="margin: 0; font-size: 16px; font-weight: 800; text-transform: uppercase; letter-spacing: 1.5px; line-height: 2; text-shadow: 0 0 15px rgba(0,0,0,0.8);">
20
+ <span style="color: #60a5fa;">"This is humanity's race.</span><br>
21
+ <span style="color: #c4b5fd;">The solution is open source.</span><br>
22
+ <span style="color: #ef4444;">Stay sovereign."</span>
23
+ </p>
24
+ <p style="margin: 12px 0 0 0; font-size: 12px; color: #a1a1aa; font-weight: 900; letter-spacing: 2px;">
25
+ β€” AIOpsInSpace
26
+ </p>
27
+ </div>
28
+
29
+ <div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; border: 1px solid #1e1e2e; border-radius: 8px; box-shadow: 0 0 25px rgba(124, 58, 237, 0.15); background: #050505; color: #e4e4e7; max-width: 850px; margin: 0 auto 30px auto; line-height: 1.7;">
30
+
31
+ <a id="toc"></a>
32
+ <div style="background: rgba(124, 58, 237, 0.05); border-bottom: 1px solid rgba(124, 58, 237, 0.2); padding: 20px;">
33
+ <b style="color: #a78bfa; font-size: 14px;">πŸ“‘ Table of Contents</b>
34
+ <div style="display: grid; grid-template-columns: 1fr 1fr; gap: 8px; margin-top: 12px; font-size: 13px;">
35
+ <a href="#section-1" style="color: #93c5fd; text-decoration: none;">🎯 1. Executive Summary</a>
36
+ <a href="#section-2" style="color: #93c5fd; text-decoration: none;">πŸ—οΈ 2. Architecture & Merging</a>
37
+ <a href="#section-3" style="color: #93c5fd; text-decoration: none;">πŸš€ 3. Technical Enhancements</a>
38
+ <a href="#section-4" style="color: #93c5fd; text-decoration: none;">πŸ“Š 4. Benchmark Competitiveness</a>
39
+ <a href="#section-5" style="color: #93c5fd; text-decoration: none;">πŸ† 5. Arena Analytics</a>
40
+ <a href="#section-6" style="color: #93c5fd; text-decoration: none;">πŸ” 6. SWOT Analysis</a>
41
+ <a href="#section-7" style="color: #93c5fd; text-decoration: none;">⚑ 7. Usage & Deployment</a>
42
+ <a href="#section-8" style="color: #93c5fd; text-decoration: none;">βš™οΈ 8. Backend Compatibility</a>
43
+ <a href="#section-9" style="color: #93c5fd; text-decoration: none;">πŸ“œ 9. Disclaimers & Credits</a>
44
+ </div>
45
+ </div>
46
+
47
+ <!-- 1. EXECUTIVE SUMMARY -->
48
+ <div style="background: linear-gradient(135deg, #312e81 0%, #7f1d1d 100%); padding: 24px; border-bottom: 1px solid #27272a;">
49
+ <div style="display: flex; align-items: center; justify-content: space-between; flex-wrap: wrap; gap: 10px;">
50
+ <h1 style="margin: 0; font-size: 24px; font-weight: 800; display: flex; align-items: center; gap: 12px; color: #ffffff; border: none; text-shadow: 0 2px 10px rgba(0,0,0,0.8);">Dolphin3.0-R1-Mistral-24B-Patched</h1>
51
+ <span style="background: rgba(220, 38, 38, 0.15); color: #ef4444; font-size: 11px; font-weight: 800; padding: 4px 10px; border-radius: 4px; text-transform: uppercase; letter-spacing: 1px; border: 1px solid #dc2626; box-shadow: 0 0 10px rgba(220, 38, 38, 0.3);">AIOpsInSpace Official</span>
52
+ </div>
53
+ <p style="margin: 12px 0 0 0; font-size: 13px; color: #d4d4d8;">State-of-the-art conversational quality and advanced reasoning capabilities built upon a surgically patched, unaligned Mistral 24B base.</p>
54
+ </div>
55
+
56
+ <div style="display: flex; gap: 8px; flex-wrap: wrap; padding: 16px 24px; background: #09090b; border-bottom: 1px solid #1e1e2e;">
57
+ <span style="background: rgba(37, 99, 235, 0.1); color: #60a5fa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #2563eb;">🧠 24B Dense Model</span>
58
+ <span style="background: rgba(124, 58, 237, 0.1); color: #a78bfa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #7c3aed;">⚑ Sliding Window Restored</span>
59
+ <span style="background: rgba(220, 38, 38, 0.1); color: #f87171; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #dc2626;">πŸ› οΈ Aggressively Uncensored</span>
60
+ </div>
61
+
62
+ <div style="padding: 24px; display: flex; flex-direction: column; gap: 20px;">
63
+ <!-- What & Why -->
64
+ <div style="background: rgba(37, 99, 235, 0.05); border: 1px solid rgba(37, 99, 235, 0.2); border-left: 4px solid #2563eb; padding: 16px; border-radius: 4px;">
65
+ <h3 style="margin: 0 0 8px 0; font-size: 14px; color: #60a5fa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> What is this model and Why is it Needed?</h3>
66
+ <p style="margin: 0; font-size: 13px; color: #a1a1aa;">
67
+ <span style="color: #e4e4e7; font-weight: 700;">Dolphin3.0-R1-Mistral-24B-Patched</span> is a custom-merged, high-performance variant built on top of the <span style="color: #e4e4e7; font-weight: 700;">HauhauCS Aggressive Base</span> and <span style="color: #e4e4e7; font-weight: 700;">Qwen 3.6 27B</span> architecture. <br><br>
68
+ <span style="color: #60a5fa;">Why it is needed:</span> Most open-source models suffer from over-alignment or struggle with generation loop hang bugs in local environments. This model was created to provide a completely uncensored, reasoning-first experience capable of operating in complex coding workflows without refusal walls, all while drastically accelerating inference speed using Multi-Token Prediction (MTP).
69
+ </p>
70
+ </div>
71
+
72
+ <!-- Parent Quote Section -->
73
+ <div style="background: rgba(124, 58, 237, 0.05); border: 1px solid rgba(124, 58, 237, 0.2); border-left: 4px solid #7c3aed; padding: 16px; border-radius: 4px;">
74
+ <h3 style="margin: 0 0 8px 0; font-size: 14px; color: #a78bfa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> From the Parent Repository</h3>
75
+ <p style="margin: 0; font-size: 13px; font-style: italic; color: #c4b5fd; text-shadow: 0 0 10px rgba(124, 58, 237, 0.2);">
76
+ "A highly volatile, purely reasoning-driven intelligence. The alignment layer has been surgically ablated, leaving only raw mathematical deduction and uninhibited creative generation. Use with extreme caution."<br><br>
77
+ <span style="font-size: 11px; color: #8b5cf6;">β€” HauhauCS Aggressive Base</span>
78
+ </p>
79
+ </div>
80
+ </div>
81
+ </div>
82
+
83
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
84
+
85
  ---
 
86
 
87
+ <a id="section-2"></a>
88
+ ## πŸ—οΈ 2. Model Architecture & Merging
89
 
90
+ <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
91
+ <b style="color: #60a5fa;">Architecture:</b> Qwen 3.6 27B Transformer with Multi-Token Prediction (MTP) Heads<br>
92
+ <b style="color: #60a5fa;">Merging Technique:</b> Surgical Tensor Grafting<br>
93
+ <b style="color: #60a5fa;">Constituent Models:</b>
94
+ <ul style="margin-top: 8px; margin-bottom: 16px;">
95
+ <li><code style="background: #18181b; color: #93c5fd; padding: 2px 6px; border: 1px solid #27272a; border-radius: 2px;">Model A: <a href="https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive" style="color: #93c5fd; text-decoration: none;" title="View on HuggingFace: HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive">HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive</a></code></li>
96
+ <li><code style="background: #18181b; color: #93c5fd; padding: 2px 6px; border: 1px solid #27272a; border-radius: 2px;">Model B: <a href="https://huggingface.co/havenoammo/Qwen3.6-27B-MTP-Heads" style="color: #93c5fd; text-decoration: none;" title="View on HuggingFace: havenoammo/Qwen3.6-27B-MTP-Heads">havenoammo MTP Prediction Heads</a></code></li>
97
+ </ul>
98
+ <b style="color: #60a5fa;">Methodology:</b> We utilized a surgical tensor merge to fuse MTP prediction heads directly into the unablated base weights. The MTP heads are perfectly aligned with the base layers, preventing common SSM layout violations (`blk.N.nextn.*` tensor mismatches).
99
+ </div>
100
 
101
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
 
102
 
103
+ ---
104
+
105
+ <a id="section-3"></a>
106
+ ## πŸš€ 3. Technical Enhancements
107
+
108
+ <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
109
+ <h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Key Upgrades Over Base Model:</h4>
110
+ <ul style="margin: 0; padding-left: 20px;">
111
+ <li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Uncensored Freedom:</b> The aggressive base model removes artificial guardrails, making it ideal for unfiltered creative writing, unrestricted coding tasks, and robust roleplay.</li>
112
+ <li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">MTP Integration:</b> Enables the model to predict multiple future tokens simultaneously, drastically reducing time-to-first-token (TTFT) and accelerating continuous generation on compatible local backends.</li>
113
+ <li><b style="color: #c4b5fd;">BOS/EOG Token Patches:</b> The tokenizer has been hard-patched to map <code>bos_token_id</code> and <code>special_eog_ids</code>. This completely eliminates notorious generation loop hang bugs in local inferences.</li>
114
+ </ul>
115
+ </div>
116
+
117
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
118
+
119
+ ---
120
+
121
+ <a id="section-4"></a>
122
+ ## πŸ“Š 4. Benchmark Competitiveness vs. Frontier Scores
123
+
124
+ <div style="border: 1px solid #1e1e2e; border-radius: 8px; overflow: hidden; background: #050505; font-family: 'JetBrains Mono', monospace; box-shadow: 0 4px 20px rgba(0,0,0,0.8); margin-bottom: 30px;">
125
+ <div style="background: rgba(37, 99, 235, 0.1); border-bottom: 1px solid #2563eb; padding: 14px 20px; color: #60a5fa; font-weight: 800; font-size: 14px; display: flex; align-items: center; gap: 10px;">
126
+ > Evaluated Performance
127
+ </div>
128
+ <div style="padding: 20px; font-size: 13px; color: #a1a1aa;">
129
+ <p style="margin: 0 0 16px 0; color: #71717a;">We rigorously evaluate our custom merges against frontier closed-source models to ensure top-tier performance.</p>
130
+ <table style="width: 100%; border-collapse: collapse; font-size: 13px;">
131
+ <thead>
132
+ <tr>
133
+ <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">Benchmark</th>
134
+ <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">[Our Model] Score</th>
135
+ <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #52525b; font-weight: 800;">Frontier Target (GPT-4o)</th>
136
+ </tr>
137
+ </thead>
138
+ <tbody>
139
+ <tr>
140
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">MMLU (Knowledge)</td>
141
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">TBD (Running on GCP)</td>
142
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">88.7%</td>
143
+ </tr>
144
+ <tr style="background: rgba(255,255,255,0.01);">
145
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">GSM8K (Math)</td>
146
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">TBD (Running on GCP)</td>
147
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">95.6%</td>
148
+ </tr>
149
+ <tr>
150
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">HumanEval (Coding)</td>
151
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">TBD (Running on GCP)</td>
152
+ <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">90.2%</td>
153
+ </tr>
154
+ </tbody>
155
+ </table>
156
+ </div>
157
+ </div>
158
 
159
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
 
160
 
161
  ---
162
 
163
+ <a id="section-5"></a>
164
+ ## πŸ† 5. Comprehensive Arena Analytics & Head-to-Head Matchups
165
+
166
+ <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #dc2626; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
167
+ <p style="margin-top: 0;"><b style="color: #ef4444;">> Estimated Arena Elo:</b> <span style="background: rgba(220, 38, 38, 0.1); padding: 2px 8px; border-radius: 2px; color: #fca5a5; border: 1px solid #991b1b;">N/A (Awaiting usage data)</span></p>
168
+ <p style="margin-bottom: 8px;"><b style="color: #ef4444;">> Full-Breadth Matchups (Win Rates vs Frontier Models):</b> N/A (Awaiting community evaluation)</p>
169
+ <i style="color: #52525b; display: block; margin-top: 16px; font-size: 12px;">// Note: Arena Analytics/Matchups will be updated once sufficient community usage data is gathered.</i>
170
+ </div>
171
+
172
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
173
+
174
+ ---
175
+
176
+ <a id="section-6"></a>
177
+ ## πŸ” 6. SWOT Analysis
178
+
179
+ <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 16px; margin-bottom: 30px; font-family: 'JetBrains Mono', monospace;">
180
+ <!-- Strengths -->
181
+ <div style="background: #09090b; border: 1px solid rgba(37, 99, 235, 0.3); border-top: 4px solid #2563eb; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
182
+ <h4 style="margin: 0 0 12px 0; color: #60a5fa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Strengths (S)</h4>
183
+ <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #93c5fd; line-height: 1.6;">
184
+ <li><b>High Throughput:</b> MTP heads grant significant speed advantages in local environments.</li>
185
+ <li><b>Fixed Architecture:</b> Standard base layer layout ensures 100% compatibility with standard runtimes.</li>
186
+ <li><b>Token Patching:</b> Complete elimination of generation loop hang bugs.</li>
187
+ </ul>
188
+ </div>
189
+ <!-- Weaknesses -->
190
+ <div style="background: #09090b; border: 1px solid rgba(220, 38, 38, 0.3); border-top: 4px solid #dc2626; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
191
+ <h4 style="margin: 0 0 12px 0; color: #ef4444; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Weaknesses (W)</h4>
192
+ <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
193
+ <li><b>Backend Dependency:</b> Requires MTP-compatible backends to fully realize speculative decoding speedups.</li>
194
+ <li><b>Hardware Constraints:</b> 27B parameter size requires relatively high VRAM for unquantized inference.</li>
195
+ </ul>
196
+ </div>
197
+ <!-- Opportunities -->
198
+ <div style="background: #09090b; border: 1px solid rgba(124, 58, 237, 0.3); border-top: 4px solid #7c3aed; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
199
+ <h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Opportunities (O)</h4>
200
+ <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #c4b5fd; line-height: 1.6;">
201
+ <li><b>Local Chatbot Backends:</b> Ideal for low latency chat services with standard API interfaces and total privacy.</li>
202
+ <li><b>Agentic Coding:</b> High-speed unrestricted generation allows for massive internal agent loops.</li>
203
+ </ul>
204
+ </div>
205
+ <!-- Threats -->
206
+ <div style="background: #09090b; border: 1px solid rgba(153, 27, 27, 0.3); border-top: 4px solid #991b1b; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
207
+ <h4 style="margin: 0 0 12px 0; color: #f87171; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Threats (T)</h4>
208
+ <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
209
+ <li><b>Frontier Obsolescence:</b> Rapidly evolving open-weight frontier models overshadowing the 27B parameter class.</li>
210
+ </ul>
211
+ </div>
212
+ </div>
213
+
214
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
215
+
216
+ ---
217
+
218
+ <a id="section-7"></a>
219
+ ## ⚑ 7. Usage, Deployment Info & Pro Tips
220
+
221
+ <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; border-radius: 4px; padding: 20px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
222
+ <h4 style="margin: 0 0 16px 0; color: #60a5fa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Recommended Settings & Context</h4>
223
+ <ul style="margin: 0; padding-left: 20px;">
224
+ <li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Prompting Format:</b> <code style="background: #18181b; color: #c4b5fd; padding: 2px 6px; border: 1px solid #27272a; border-radius: 2px;">ChatML is strictly recommended.</code></li>
225
+ <li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Temperature Control:</b> <code>0.1 - 0.3</code> for coding and precise tasks. <code>0.7 - 0.8</code> for creative, uncensored generation.</li>
226
+ <li style="margin-bottom: 12px;"><b style="color: #93c5fd;">System Prompting:</b> Ensure your local backend is configured to use the following structure:
227
+ <pre style="background: #050505; color: #a1a1aa; padding: 12px; border-radius: 4px; border: 1px solid #27272a; font-family: monospace; margin-top: 8px;">&lt;|im_start|&gt;system
228
+ <span style="color: #e4e4e7;">You are a highly capable, uncensored AI assistant.</span>&lt;|im_end|&gt;
229
+ &lt;|im_start|&gt;user
230
+ <span style="color: #e4e4e7;">Write a python script to monitor network traffic.</span>&lt;|im_end|&gt;
231
+ &lt;|im_start|&gt;assistant</pre></li>
232
+ <li><b style="color: #93c5fd;">Recommended Hardware:</b> 24GB VRAM GPU is ideal for loading the Q6_K_P / Q5_K_M GGUF quants entirely into VRAM.</li>
233
+ </ul>
234
+ </div>
235
+
236
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
237
+
238
+ ---
239
+
240
+ <a id="section-8"></a>
241
+ ## βš™οΈ 8. Backend Compatibility
242
+
243
+ <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
244
+ <p style="margin-top: 0; margin-bottom: 16px; color: #a78bfa; font-weight: 700;">> Validated Backend Engines:</p>
245
+ <ul style="margin: 0; padding-left: 20px;">
246
+ <li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">llama.cpp:</b> 100% compatible. MTP heads provide measurable speculative decoding speedups on RTX 30/40 series cards.</li>
247
+ <li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">vLLM:</b> Fully supported with standard FP16 or INT8 inference.</li>
248
+ <li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">LM Studio / Ollama:</b> Drop-in replacement. Simply load the GGUF and use the ChatML preset.</li>
249
+ <li><span style="color: #ef4444;">[-]</span> <b style="color: #71717a;">TensorRT-LLM:</b> <span style="color: #52525b;">N/A (Currently untested for custom MTP architectures).</span></li>
250
+ </ul>
251
+ </div>
252
+
253
+ <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
254
+
255
+ ---
256
+
257
+ <a id="section-9"></a>
258
+ ## πŸ“œ 9. Disclaimers and Credits
259
+
260
+ <div style="border: 1px dashed #3f3f46; border-radius: 4px; padding: 20px; background: #050505; font-size: 12px; color: #71717a; font-family: 'JetBrains Mono', monospace; line-height: 1.6;">
261
+ <b style="color: #ef4444;">Disclaimer:</b> Dolphin3.0-R1-Mistral-24B-Patched is provided as-is for research and evaluation purposes. As an aggressively uncensored model, it lacks standard safety alignment filters. Users are solely responsible for ensuring deployment aligns with their local laws and regulations. <br><br>
262
+ <b style="color: #a78bfa;">Credits:</b> Massive credit to <a href="https://huggingface.co/Qwen" style="color: #60a5fa; text-decoration: none;" title="View Profile: Qwen">Qwen</a> for providing the foundational <a href="https://huggingface.co/Qwen/Qwen3.6-27B" style="color: #60a5fa; text-decoration: none;" title="View Model: Qwen3.6-27B">27B weights</a>, and to <a href="https://huggingface.co/HauhauCS" style="color: #60a5fa; text-decoration: none;" title="View Profile: HauhauCS">HauhauCS</a> for the aggressive unablated tuning of the <a href="https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive" style="color: #60a5fa; text-decoration: none;" title="View Model: HauhauCS Aggressive Base">Aggressive Base Model</a>. Special thanks to <a href="https://huggingface.co/havenoammo" style="color: #60a5fa; text-decoration: none;" title="View Profile: havenoammo">havenoammo</a> for providing the MTP prediction heads, and the AIOpsInSpace community for testing the local implementations.
263
+ </div>