| ---
|
| base_model: cognitivecomputations/Dolphin3.0-Mistral-24B
|
| tags:
|
| - text-generation
|
| - gguf
|
| - uncensored
|
| - reasoning
|
| - dolphin
|
| - mistral
|
| - r1
|
| license: apache-2.0
|
| language:
|
| - en
|
| pipeline_tag: text-generation
|
| ---
|
|
|
| <div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; max-width: 850px; margin: 0 auto 30px auto; padding: 20px; background: #050505; border-left: 4px solid #2563eb; border-right: 4px solid #dc2626; box-shadow: 0 0 15px rgba(124, 58, 237, 0.1); text-align: center;">
|
| <p style="margin: 0; font-size: 16px; font-weight: 800; text-transform: uppercase; letter-spacing: 1.5px; line-height: 2; text-shadow: 0 0 15px rgba(0,0,0,0.8);">
|
| <span style="color: #60a5fa;">"This is humanity's race.</span><br>
|
| <span style="color: #c4b5fd;">The solution is open source.</span><br>
|
| <span style="color: #ef4444;">Stay sovereign."</span>
|
| </p>
|
| <p style="margin: 12px 0 0 0; font-size: 12px; color: #a1a1aa; font-weight: 900; letter-spacing: 2px;">
|
| — AIOpsInSpace
|
| </p>
|
| </div>
|
|
|
| <div style="font-family: 'JetBrains Mono', 'Fira Code', 'Roboto Mono', Consolas, monospace; border: 1px solid #1e1e2e; border-radius: 8px; box-shadow: 0 0 25px rgba(124, 58, 237, 0.15); background: #050505; color: #e4e4e7; max-width: 850px; margin: 0 auto 30px auto; line-height: 1.7;">
|
|
|
| <a id="toc"></a>
|
| <div style="background: rgba(124, 58, 237, 0.05); border-bottom: 1px solid rgba(124, 58, 237, 0.2); padding: 20px;">
|
| <b style="color: #a78bfa; font-size: 14px;">📑 Table of Contents</b>
|
| <div style="display: grid; grid-template-columns: 1fr 1fr; gap: 8px; margin-top: 12px; font-size: 13px;">
|
| <a href="#section-1" style="color: #93c5fd; text-decoration: none;">🎯 1. Executive Summary</a>
|
| <a href="#section-2" style="color: #93c5fd; text-decoration: none;">🏗️ 2. Architecture & Merging</a>
|
| <a href="#section-3" style="color: #93c5fd; text-decoration: none;">🚀 3. Technical Enhancements</a>
|
| <a href="#section-4" style="color: #93c5fd; text-decoration: none;">📊 4. Benchmark Competitiveness</a>
|
| <a href="#section-5" style="color: #93c5fd; text-decoration: none;">🏆 5. Arena Analytics</a>
|
| <a href="#section-6" style="color: #93c5fd; text-decoration: none;">🔍 6. SWOT Analysis</a>
|
| <a href="#section-7" style="color: #93c5fd; text-decoration: none;">⚡ 7. Usage & Deployment</a>
|
| <a href="#section-8" style="color: #93c5fd; text-decoration: none;">⚙️ 8. Backend Compatibility</a>
|
| <a href="#section-9" style="color: #93c5fd; text-decoration: none;">📜 9. Disclaimers & Credits</a>
|
| </div>
|
| </div>
|
|
|
| <!-- 1. EXECUTIVE SUMMARY -->
|
| <div style="background: linear-gradient(135deg, #312e81 0%, #7f1d1d 100%); padding: 24px; border-bottom: 1px solid #27272a;">
|
| <div style="display: flex; align-items: center; justify-content: space-between; flex-wrap: wrap; gap: 10px;">
|
| <h1 style="margin: 0; font-size: 24px; font-weight: 800; display: flex; align-items: center; gap: 12px; color: #ffffff; border: none; text-shadow: 0 2px 10px rgba(0,0,0,0.8);">Dolphin3.0-R1-Mistral-24B-Patched</h1>
|
| <span style="background: rgba(220, 38, 38, 0.15); color: #ef4444; font-size: 11px; font-weight: 800; padding: 4px 10px; border-radius: 4px; text-transform: uppercase; letter-spacing: 1px; border: 1px solid #dc2626; box-shadow: 0 0 10px rgba(220, 38, 38, 0.3);">AIOpsInSpace Official</span>
|
| </div>
|
| <p style="margin: 12px 0 0 0; font-size: 13px; color: #d4d4d8;">Dolphin 3.0 Mistral 24B with R1 reasoning distillation, patched for local execution stability.</p>
|
| </div>
|
|
|
| <div style="display: flex; gap: 8px; flex-wrap: wrap; padding: 16px 24px; background: #09090b; border-bottom: 1px solid #1e1e2e;">
|
| <span style="background: rgba(37, 99, 235, 0.1); color: #60a5fa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #2563eb;">🧠 24B Dense Model</span>
|
| <span style="background: rgba(124, 58, 237, 0.1); color: #a78bfa; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #7c3aed;">⚡ R1 Reasoning Distillation</span>
|
| <span style="background: rgba(220, 38, 38, 0.1); color: #f87171; font-size: 11px; font-weight: 700; padding: 6px 12px; border-radius: 4px; border: 1px solid #dc2626;">🛠️ Aggressively Uncensored</span>
|
| </div>
|
|
|
| <div style="padding: 24px; display: flex; flex-direction: column; gap: 20px;">
|
| <!-- What & Why -->
|
| <div style="background: rgba(37, 99, 235, 0.05); border: 1px solid rgba(37, 99, 235, 0.2); border-left: 4px solid #2563eb; padding: 16px; border-radius: 4px;">
|
| <h3 style="margin: 0 0 8px 0; font-size: 14px; color: #60a5fa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> What is this model and Why is it Needed?</h3>
|
| <p style="margin: 0; font-size: 13px; color: #a1a1aa;">
|
| Dolphin3.0-R1-Mistral-24B-Patched combines Cognitive Computations Dolphin 3.0 uncensored fine-tuning with DeepSeek-R1 reasoning trace capabilities.<br><br><span style="color: #60a5fa;">Why it is needed:</span> Provides DeepSeek-R1 level reasoning trace formatting (<think> tags) in a 24B Mistral footprint while fixing tokenizer hangs on local backends.
|
| </p>
|
| </div>
|
|
|
| <!-- Parent Quote Section -->
|
| <div style="background: rgba(124, 58, 237, 0.05); border: 1px solid rgba(124, 58, 237, 0.2); border-left: 4px solid #7c3aed; padding: 16px; border-radius: 4px;">
|
| <h3 style="margin: 0 0 8px 0; font-size: 14px; color: #a78bfa; font-weight: 800; display: flex; align-items: center; gap: 8px; text-transform: uppercase; letter-spacing: 0.5px;">> From the Parent Repository</h3>
|
| <p style="margin: 0; font-size: 13px; font-style: italic; color: #c4b5fd; text-shadow: 0 0 10px rgba(124, 58, 237, 0.2);">
|
| "Dolphin 3.0 brings DeepSeek-R1 reasoning patterns into an open, uncensored Mistral backbone."<br><br>
|
| <span style="font-size: 11px; color: #8b5cf6;">— Cognitive Computations</span>
|
| </p>
|
| </div>
|
| </div>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-2"></a>
|
| ## 🏗️ 2. Model Architecture & Merging
|
|
|
| <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
|
| <b style="color: #60a5fa;">Architecture:</b> Mistral 24B Transformer with R1 Reasoning Distillation<br>
|
| <b style="color: #60a5fa;">Merging Technique:</b> Reasoning Format Alignment & GGUF Metadata Fixes<br>
|
| <b style="color: #60a5fa;">Constituent Models:</b>
|
| <ul style="margin-top: 8px; margin-bottom: 16px;">
|
| <li><code style="background: #18181b; color: #93c5fd; padding: 2px 6px; border: 1px solid #27272a; border-radius: 2px;">Base Model: <a href="https://huggingface.co/cognitivecomputations/Dolphin3.0-Mistral-24B" style="color: #93c5fd; text-decoration: none;">cognitivecomputations/Dolphin3.0-Mistral-24B</a></code></li>
|
| </ul>
|
| <b style="color: #60a5fa;">Methodology:</b> Applied strict tokenizer end-of-thought parsing and GGUF header repair.
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-3"></a>
|
| ## 🚀 3. Technical Enhancements
|
|
|
| <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Key Upgrades Over Base Model:</h4>
|
| <ul style="margin: 0; padding-left: 20px;">
|
| <li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Structured Reasoning:</b> Native support for <think> reasoning tags prior to output generation.</li>
|
| <li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Uncensored Freedom:</b> Zero refusal guardrails for red-teaming, complex logic, and creative tasks.</li>
|
| <li style="margin-bottom: 8px;"><b style="color: #c4b5fd;">Local Engine Fixes:</b> Eliminates infinite reasoning loop hangs in llama.cpp and Ollama.</li>
|
| </ul>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-4"></a>
|
| ## 📊 4. Benchmark Competitiveness vs. Frontier Scores
|
|
|
| <div style="border: 1px solid #1e1e2e; border-radius: 8px; overflow: hidden; background: #050505; font-family: 'JetBrains Mono', monospace; box-shadow: 0 4px 20px rgba(0,0,0,0.8); margin-bottom: 30px;">
|
| <div style="background: rgba(37, 99, 235, 0.1); border-bottom: 1px solid #2563eb; padding: 14px 20px; color: #60a5fa; font-weight: 800; font-size: 14px; display: flex; align-items: center; gap: 10px;">
|
| > Evaluated Performance
|
| </div>
|
| <div style="padding: 20px; font-size: 13px; color: #a1a1aa;">
|
| <table style="width: 100%; border-collapse: collapse; font-size: 13px;">
|
| <thead>
|
| <tr>
|
| <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">Benchmark</th>
|
| <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #93c5fd; font-weight: 800;">Dolphin3.0-R1-Mistral-24B-Patched</th>
|
| <th style="padding: 12px 16px; border-bottom: 2px solid #2563eb; text-align: left; color: #52525b; font-weight: 800;">Frontier Target</th>
|
| </tr>
|
| </thead>
|
| <tbody>
|
| <tr>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">MMLU</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">88.7%</td>
|
| </tr>
|
| <tr style="background: rgba(255,255,255,0.01);">
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">GSM8K</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">95.6%</td>
|
| </tr>
|
| <tr>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 700; color: #e4e4e7;">HumanEval</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; font-weight: 800; color: #60a5fa; text-shadow: 0 0 8px rgba(96,165,250,0.4);">Evaluated</td>
|
| <td style="padding: 12px 16px; border-bottom: 1px solid #1e1e2e; color: #71717a;">90.2%</td>
|
| </tr>
|
| </tbody>
|
| </table>
|
| </div>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-5"></a>
|
| ## 🏆 5. Comprehensive Arena Analytics
|
|
|
| <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #dc2626; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
|
| <p style="margin-top: 0;"><b style="color: #ef4444;">> Status:</b> Active Community Benchmarking</p>
|
| <i style="color: #52525b; display: block; margin-top: 12px; font-size: 12px;">// Note: Arena Elo and head-to-head winrates updated continuously as evaluation telemetry processes.</i>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-6"></a>
|
| ## 🔍 6. SWOT Analysis
|
|
|
| <div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(250px, 1fr)); gap: 16px; margin-bottom: 30px; font-family: 'JetBrains Mono', monospace;">
|
| <!-- Strengths -->
|
| <div style="background: #09090b; border: 1px solid rgba(37, 99, 235, 0.3); border-top: 4px solid #2563eb; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 12px 0; color: #60a5fa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Strengths (S)</h4>
|
| <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #93c5fd; line-height: 1.6;">
|
| <li>🛡️ <b>Uncensored Fidelity:</b> Surgically patched to ensure maximum generation throughput without alignment overhead.</li>
|
| <li>⚡ <b>Optimized Engine:</b> Advanced mechanics ensure zero context fragmentation or execution hangs.</li>
|
| </ul>
|
| </div>
|
| <!-- Weaknesses -->
|
| <div style="background: #09090b; border: 1px solid rgba(220, 38, 38, 0.3); border-top: 4px solid #dc2626; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 12px 0; color: #ef4444; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Weaknesses (W)</h4>
|
| <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
|
| <li>📉 <b>Hardware Limits:</b> Requires sufficient VRAM/RAM for higher precision GGUF quantizations.</li>
|
| </ul>
|
| </div>
|
| <!-- Opportunities -->
|
| <div style="background: #09090b; border: 1px solid rgba(124, 58, 237, 0.3); border-top: 4px solid #7c3aed; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 12px 0; color: #a78bfa; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Opportunities (O)</h4>
|
| <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #c4b5fd; line-height: 1.6;">
|
| <li>🎯 <b>Local Sovereign Agents:</b> Perfect for offline, private reasoning and agentic workflows.</li>
|
| </ul>
|
| </div>
|
| <!-- Threats -->
|
| <div style="background: #09090b; border: 1px solid rgba(153, 27, 27, 0.3); border-top: 4px solid #991b1b; padding: 20px; border-radius: 4px; box-shadow: 0 4px 10px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 12px 0; color: #f87171; font-size: 14px; font-weight: 800; text-transform: uppercase; letter-spacing: 0.5px;">> Threats (T)</h4>
|
| <ul style="margin: 0; padding-left: 20px; font-size: 12px; color: #fca5a5; line-height: 1.6;">
|
| <li>⚠️ <b>Sampler Sensitivity:</b> High temperatures may require repetition penalty adjustments.</li>
|
| </ul>
|
| </div>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-7"></a>
|
| ## ⚡ 7. Usage & Deployment Info
|
|
|
| <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #2563eb; border-radius: 4px; padding: 20px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
|
| <h4 style="margin: 0 0 16px 0; color: #60a5fa; font-size: 14px; text-transform: uppercase; letter-spacing: 0.5px;">> Recommended Settings</h4>
|
| <ul style="margin: 0; padding-left: 20px;">
|
| <li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Temperature:</b> 0.2 - 0.7</li>
|
| <li style="margin-bottom: 8px;"><b style="color: #93c5fd;">Top-P:</b> 0.95</li>
|
| <li><b style="color: #93c5fd;">Backend Engines:</b> Compatible with llama.cpp, vLLM, Ollama, LM Studio, KoboldCPP</li>
|
| </ul>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-8"></a>
|
| ## ⚙️ 8. Backend Compatibility
|
|
|
| <div style="background: #09090b; border: 1px solid #1e1e2e; border-left: 4px solid #7c3aed; padding: 20px; border-radius: 4px; font-size: 13px; color: #a1a1aa; font-family: 'JetBrains Mono', monospace; margin-bottom: 30px; box-shadow: 0 4px 15px rgba(0,0,0,0.5);">
|
| <p style="margin-top: 0; margin-bottom: 16px; color: #a78bfa; font-weight: 700;">> Validated Engines:</p>
|
| <ul style="margin: 0; padding-left: 20px;">
|
| <li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">llama.cpp:</b> Native support across all quantizations.</li>
|
| <li style="margin-bottom: 8px;"><span style="color: #60a5fa;">[+]</span> <b style="color: #e4e4e7;">Ollama / LM Studio:</b> Full GGUF compatibility.</li>
|
| </ul>
|
| </div>
|
|
|
| <div style="text-align: right; margin-top: 20px; margin-bottom: 20px;"><a href="#toc" style="color: #60a5fa; text-decoration: none; font-size: 12px; font-family: monospace; border: 1px solid rgba(37,99,235,0.3); padding: 4px 8px; border-radius: 4px; background: rgba(37,99,235,0.1);">↑ Back to Top</a></div>
|
|
|
| ---
|
|
|
| <a id="section-9"></a>
|
| ## 📜 9. Disclaimers & Credits
|
|
|
| <div style="border: 1px dashed #3f3f46; border-radius: 4px; padding: 20px; background: #050505; font-size: 12px; color: #71717a; font-family: 'JetBrains Mono', monospace; line-height: 1.6;">
|
| <b style="color: #ef4444;">Disclaimer:</b> Dolphin3.0-R1-Mistral-24B-Patched is provided for research and sovereign local deployment. As an unaligned model, users are responsible for ensuring usage complies with local laws.<br><br>
|
| <b style="color: #a78bfa;">Credits:</b> Gratitude to original base model authors (cognitivecomputations/Dolphin3.0-Mistral-24B) and open-source AI community tools.
|
| </div>
|
|
|
