README.md

---

base_model: cognitivecomputations/Dolphin3.0-Mistral-24B
tags:
- text-generation
- gguf
- uncensored
- reasoning
- dolphin
- mistral
- r1
license: apache-2.0
language:
- en
pipeline_tag: text-generation
---


<div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; max-width: 850px; margin: 0 auto 30px auto; padding: 20px; background: #050505; border-left: 4px solid #2563eb; border-right: 4px solid #dc2626; box-shadow: 0 0 15px rgba(124, 58, 237, 0.1); text-align: center;">
<p style="margin: 0; font-size: 16px; font-weight: 800; text-transform: uppercase; letter-spacing: 1.5px; line-height: 2; text-shadow: 0 0 15px rgba(0,0,0,0.8);">
<span style="color: #60a5fa;">"This is humanity's race.</span><br>
<span style="color: #c4b5fd;">The solution is open source.</span><br>
<span style="color: #ef4444;">Stay sovereign."</span>
</p>
<p style="margin: 12px 0 0 0; font-size: 12px; color: #a1a1aa; font-weight: 900; letter-spacing: 2px;">
— AIOpsInSpace
</p>
</div>

<div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; border: 1px solid #1e1e2e; border-radius: 8px; box-shadow: 0 0 25px rgba(124, 58, 237, 0.15); background: #050505; color: #e4e4e7; max-width: 850px; margin: 0 auto 30px auto; line-height: 1.7;">
  
<a id="toc"></a>
<div style="background: rgba(124, 58, 237, 0.05); border-bottom: 1px solid rgba(124, 58, 237, 0.2); padding: 20px;">
<b style="color: #a78bfa; font-size: 14px;">📑 Table of Contents</b>
<div style="display: grid; grid-template-columns: 1fr 1fr; gap: 8px; margin-top: 12px; font-size: 13px;">
<a href="#section-1" style="color: #93c5fd; text-decoration: none;">🎯 1. Executive Summary</a>
<a href="#section-2" style="color: #93c5fd; text-decoration: none;">🏗️ 2. Architecture & Merging</a>
<a href="#section-3" style="color: #93c5fd; text-decoration: none;">🚀 3. Technical Enhancements</a>
<a href="#section-4" style="color: #93c5fd; text-decoration: none;">📊 4. Benchmark Competitiveness</a>
<a href="#section-5" style="color: #93c5fd; text-decoration: none;">🏆 5. Arena Analytics</a>
<a href="#section-6" style="color: #93c5fd; text-decoration: none;">🔍 6. SWOT Analysis</a>
<a href="#section-7" style="color: #93c5fd; text-decoration: none;">⚡ 7. Usage & Deployment</a>
<a href="#section-8" style="color: #93c5fd; text-decoration: none;">⚙️ 8. Backend Compatibility</a>
<a href="#section-9" style="color: #93c5fd; text-decoration: none;">📜 9. Disclaimers & Credits</a>
</div>
</div>

<!-- 1. EXECUTIVE SUMMARY -->
<div style="background: linear-gradient(135deg, #312e81 0%, #7f1d1d 100%); padding: 24px; border-bottom: 1px solid #27272a;">
<div style="display: flex; align-items: center; justify-content: space-between; flex-wrap: wrap; gap: 10px;">
<h1 style="margin: 0; font-size: 24px; font-weight: 800; display: flex; align-items: center; gap: 12px; color: #ffffff; border: none; text-shadow: 0 2px 10px rgba(0,0,0,0.8);">Dolphin3.0-R1-Mistral-24B-Patched</h1>
<span style="background: rgba(220, 38, 38, 0.15); color: #ef4444; font-size: 11px; font-weight: 800; padding: 4px 10px; border-radius: 4px; text-transform: uppercase; letter-spacing: 1px; border: 1px solid #dc2626; box-shadow: 0 0 10px rgba(220, 38, 38, 0.3);">AIOpsInSpace Official</span>
</div>
<p style="margin: 12px 0 0 0; font-size: 13px; color: #d4d4d8;">Dolphin 3.0 Mistral 24B with R1 reasoning distillation, patched for local execution stability.</p>
</div>
  
<div style="display: flex; gap: 8px; flex-wrap: wrap; padding: 16px 24px; background: #09090b; border-bottom: 1px solid #1e1e2e;">
<span style="background: rgba(37, 99, 235, 0.1); color: #60a5fa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #2563eb;">🧠 24B Dense Model</span>
<span style="background: rgba(124, 58, 237, 0.1); color: #a78bfa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #7c3aed;">⚡ R1 Reasoning Distillation</span>
<span style="background: rgba(220, 38, 38, 0.1); color: #f87171; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #dc2626;">🛠️ Aggressively Uncensored</span>
</div>

<div style="padding: 24px; display: flex; flex-direction: column; gap: 20px;">
<!-- What & Why -->
<div style="background: rgba(37, 99, 235, 0.05); border: 1px solid rgba(37, 99, 235, 0.2); border-left: 4px solid #2563eb; padding: 16px; border-radius: 4px;">
<h3 style="margin: 0 0 8px 0; font-size: 14px; color: #60a5fa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> What is this model and Why is it Needed?</h3>
<p style="margin: 0; font-size: 13px; color: #a1a1aa;">
Dolphin3.0-R1-Mistral-24B-Patched combines Cognitive Computations Dolphin 3.0 uncensored fine-tuning with DeepSeek-R1 reasoning trace capabilities.<br><br><span style="color: #60a5fa;">Why it is needed:</span> Provides DeepSeek-R1 level reasoning trace formatting (<think> tags) in a 24B Mistral footprint while fixing tokenizer hangs on local backends.
</p>
</div>

<!-- Parent Quote Section -->
<div style="background: rgba(124, 58, 237, 0.05); border: 1px solid rgba(124, 58, 237, 0.2); border-left: 4px solid #7c3aed; padding: 16px; border-radius: 4px;">
<h3 style="margin: 0 0 8px 0; font-size: 14px; color: #a78bfa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> From the Parent Repository</h3>
<p style="margin: 0; font-size: 13px; font-style: italic; color: #c4b5fd; text-shadow: 0 0 10px rgba(124, 58, 237, 0.2);">
"Dolphin 3.0 brings DeepSeek-R1 reasoning patterns into an open, uncensored Mistral backbone."<br><br>
<span style="font-size: 11px; color: #8b5cf6;">— Cognitive Computations</span>
</p>
</div>
</div>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-2"></a>
## 🏗️ 2. Model Architecture & Merging

<div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
<b style="color: #60a5fa;">Architecture:</b> Mistral 24B Transformer with R1 Reasoning Distillation<br>
<b style="color: #60a5fa;">Merging Technique:</b> Reasoning Format Alignment & GGUF Metadata Fixes<br>
<b style="color: #60a5fa;">Constituent Models:</b>
<ul style="margin-top: 8px; margin-bottom: 16px;">
<li><code style="background: #18181b; color: #93c5fd; padding: 2px 6px; border: 1px solid #27272a; border-radius: 2px;">Base Model: <a href="https://huggingface.co/cognitivecomputations/Dolphin3.0-Mistral-24B" style="color: #93c5fd; text-decoration: none;">cognitivecomputations/Dolphin3.0-Mistral-24B</a></code></li>
</ul>
<b style="color: #60a5fa;">Methodology:</b> Applied strict tokenizer end-of-thought parsing and GGUF header repair.
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-3"></a>
## 🚀 3. Technical Enhancements

<div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Key Upgrades Over Base Model:</h4>
<ul style="margin: 0; padding-left: 20px;">
<li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Structured Reasoning:</b> Native support for <think> reasoning tags prior to output generation.</li>
<li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Uncensored Freedom:</b> Zero refusal guardrails for red-teaming, complex logic, and creative tasks.</li>
<li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Local Engine Fixes:</b> Eliminates infinite reasoning loop hangs in llama.cpp and Ollama.</li>
</ul>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-4"></a>
## 📊 4. Benchmark Competitiveness vs. Frontier Scores

<div style="border: 1px solid #1e1e2e; border-radius: 8px; overflow: hidden; background: #050505; font-family: 'JetBrains Mono', monospace; box-shadow: 0 4px 20px rgba(0,0,0,0.8); margin-bottom: 30px;">
<div style="background: rgba(37, 99, 235, 0.1); border-bottom: 1px solid #2563eb; padding: 14px 20px; color: #60a5fa; font-weight: 800; font-size: 14px; display: flex; align-items: center; gap: 10px;">
    > Evaluated Performance

</div>

<div style="padding: 20px; font-size: 13px; color: #a1a1aa;">

<table style="width: 100%; border-collapse: collapse; font-size: 13px;">

<thead>

<tr>

<th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">Benchmark</th>

<th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">Dolphin3.0-R1-Mistral-24B-Patched</th>

<th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #52525b; font-weight: 800;">Frontier Target</th>

</tr>

</thead>

<tbody>

<tr>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">MMLU</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">88.7%</td>

</tr>

<tr style="background: rgba(255,255,255,0.01);">

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">GSM8K</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">95.6%</td>

</tr>

<tr>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">HumanEval</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>

<td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">90.2%</td>

</tr>

</tbody>

</table>

</div>

</div>


<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-5"></a>
## 🏆 5. Comprehensive Arena Analytics

<div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #dc2626; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
<p style="margin-top: 0;"><b style="color: #ef4444;">> Status:</b> Active Community Benchmarking</p>
<i style="color: #52525b; display: block; margin-top: 12px; font-size: 12px;">// Note: Arena Elo and head-to-head winrates updated continuously as evaluation telemetry processes.</i>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-6"></a>
## 🔍 6. SWOT Analysis

<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 16px; margin-bottom: 30px; font-family: 'JetBrains Mono', monospace;">
<!-- Strengths -->
<div style="background: #09090b; border: 1px solid rgba(37, 99, 235, 0.3); border-top: 4px solid #2563eb; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 12px 0; color: #60a5fa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Strengths (S)</h4>
<ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #93c5fd; line-height: 1.6;">
<li>🛡️ <b>Uncensored Fidelity:</b> Surgically patched to ensure maximum generation throughput without alignment overhead.</li>
<li>⚡ <b>Optimized Engine:</b> Advanced mechanics ensure zero context fragmentation or execution hangs.</li>
</ul>
</div>
<!-- Weaknesses -->
<div style="background: #09090b; border: 1px solid rgba(220, 38, 38, 0.3); border-top: 4px solid #dc2626; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 12px 0; color: #ef4444; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Weaknesses (W)</h4>
<ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
<li>📉 <b>Hardware Limits:</b> Requires sufficient VRAM/RAM for higher precision GGUF quantizations.</li>
</ul>
</div>
<!-- Opportunities -->
<div style="background: #09090b; border: 1px solid rgba(124, 58, 237, 0.3); border-top: 4px solid #7c3aed; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Opportunities (O)</h4>
<ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #c4b5fd; line-height: 1.6;">
<li>🎯 <b>Local Sovereign Agents:</b> Perfect for offline, private reasoning and agentic workflows.</li>
</ul>
</div>
<!-- Threats -->
<div style="background: #09090b; border: 1px solid rgba(153, 27, 27, 0.3); border-top: 4px solid #991b1b; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 12px 0; color: #f87171; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Threats (T)</h4>
<ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
<li>⚠️ <b>Sampler Sensitivity:</b> High temperatures may require repetition penalty adjustments.</li>
</ul>
</div>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-7"></a>
## ⚡ 7. Usage & Deployment Info

<div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; border-radius: 4px; padding: 20px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
<h4 style="margin: 0 0 16px 0; color: #60a5fa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Recommended Settings</h4>
<ul style="margin: 0; padding-left: 20px;">
<li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Temperature:</b> 0.2 - 0.7</li>
<li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Top-P:</b> 0.95</li>
<li><b style="color: #93c5fd;">Backend Engines:</b> Compatible with llama.cpp, vLLM, Ollama, LM Studio, KoboldCPP</li>
</ul>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-8"></a>
## ⚙️ 8. Backend Compatibility

<div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
<p style="margin-top: 0; margin-bottom: 16px; color: #a78bfa; font-weight: 700;">> Validated Engines:</p>
<ul style="margin: 0; padding-left: 20px;">
<li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">llama.cpp:</b> Native support across all quantizations.</li>
<li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">Ollama / LM Studio:</b> Full GGUF compatibility.</li>
</ul>
</div>

<div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>

---

<a id="section-9"></a>
## 📜 9. Disclaimers & Credits

<div style="border: 1px dashed #3f3f46; border-radius: 4px; padding: 20px; background: #050505; font-size: 12px; color: #71717a; font-family: 'JetBrains Mono', monospace; line-height: 1.6;">
<b style="color: #ef4444;">Disclaimer:</b> Dolphin3.0-R1-Mistral-24B-Patched is provided for research and sovereign local deployment. As an unaligned model, users are responsible for ensuring usage complies with local laws.<br><br>
<b style="color: #a78bfa;">Credits:</b> Gratitude to original base model authors (cognitivecomputations/Dolphin3.0-Mistral-24B) and open-source AI community tools.
</div>