Delta-Vector
/

Mag-Picaro-72B

@@ -1,41 +1,218 @@
 ---
 base_model:
-- anthracite-org/magnum-v2-72b
 library_name: transformers
 tags:
-- mergekit
-- merge
 ---
-# model2
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
-## Merge Details
-### Merge Method
-This model was merged using the [SLERP](https://en.wikipedia.org/wiki/Slerp) merge method.
-### Models Merged
-The following models were included in the merge:
-* [anthracite-org/magnum-v2-72b](https://huggingface.co/anthracite-org/magnum-v2-72b)
-* ./model1
-### Configuration
-The following YAML configuration was used to produce this model:
-```yaml
-models:
-  - model: ./model1
-  - model: anthracite-org/magnum-v2-72b
-merge_method: slerp
-base_model: ./model1
-parameters:
-  t:
-   - value: 0.5
-dtype: bfloat16
-tokenizer_source: base
-```

 ---
 base_model:
+- Qwen/Qwen2-72B-Instruct
+pipeline_tag: text-generation
 library_name: transformers
+language:
+- en
 tags:
+- roleplay
+- finetune
+- qwen
+- story-writing
 ---
+<!DOCTYPE html>
+<html>
+<head>
+    <style>
+:root {
+    --primary: #6e48aa;
+    --secondary: #9d50bb;
+    --accent: #4776e6;
+    --bg: #1a1a2e;
+    --card-bg: #2a2a3a;
+    --text: #ffffff;
+    --highlight: #ff7e5f;
+}
+body {
+    font-family: 'Segoe UI', Tahoma, Geneva, Verdana, sans-serif;
+    background-color: var(--bg);
+    color: var(--text);
+    line-height: 1.6;
+    max-width: 900px;
+    margin: 0 auto;
+    padding: 20px;
+}
+.header {
+    text-align: center;
+    margin-bottom: 30px;
+    border-bottom: 2px solid var(--secondary);
+    padding-bottom: 20px;
+}
+h1 {
+    color: var(--highlight);
+    font-size: 2.5em;
+    margin-bottom: 10px;
+    background: linear-gradient(90deg, var(--highlight), var(--secondary));
+    -webkit-background-clip: text;
+    background-clip: text;
+    color: transparent;
+}
+.tagline {
+    font-style: italic;
+    color: var(--secondary);
+}
+.model-img {
+    border-radius: 10px;
+    border: 3px solid var(--accent);
+    box-shadow: 0 0 20px rgba(157, 80, 187, 0.3);
+    max-width: 100%;
+    height: auto;
+}
+.card {
+    background-color: var(--card-bg);
+    border-radius: 8px;
+    padding: 20px;
+    margin: 20px 0;
+    box-shadow: 0 4px 15px rgba(157, 80, 187, 0.4);
+    border-left: 4px solid var(--accent);
+    color: var(--text);
+}
+h2 {
+    color: var(--highlight);
+    border-bottom: 1px solid var(--secondary);
+    padding-bottom: 5px;
+}
+h3 {
+    color: var(--accent);
+}
+code {
+    background-color: rgba(0, 50, 0, 0.5);
+    padding: 2px 5px;
+    border-radius: 3px;
+    font-family: 'Courier New', Courier, monospace;
+    color: #00ff00;
+}
+pre {
+    background-color: #0a1a0a;
+    padding: 15px;
+    border-radius: 5px;
+    overflow-x: auto;
+    border-left: 3px solid #00ff00;
+    color: #00ff00;
+    font-family: 'Courier New', Courier, monospace;
+}
+.badge-container {
+    display: flex;
+    justify-content: center;
+    margin: 20px 0;
+}
+.badge {
+    transition: transform 0.3s;
+}
+.badge:hover {
+    transform: scale(1.05);
+}
+.details {
+    background-color: #0a1a0a;
+    border-radius: 5px;
+    padding: 10px;
+    margin: 10px 0;
+    box-shadow: 0 4px 15px rgba(0, 255, 0, 0.15);
+    color: #00ff00;
+    font-family: 'Courier New', Courier, monospace;
+    border: 1px solid #00aa00;
+}
+.details summary {
+    cursor: pointer;
+    font-weight: bold;
+    color: #00ff00;
+}
+.quant-links {
+    display: flex;
+    gap: 20px;
+    justify-content: center;
+    flex-wrap: wrap;
+}
+.quant-link {
+    background: linear-gradient(135deg, var(--primary), var(--secondary));
+    color: #ff0000;
+    padding: 10px 20px;
+    border-radius: 5px;
+    text-decoration: none;
+    font-weight: bold;
+    transition: transform 0.3s, box-shadow 0.3s;
+    border: 3px solid #ff0000;
+}
+.quant-link:hover {
+    transform: translateY(-3px);
+    box-shadow: 0 5px 15px rgba(157, 80, 187, 0.4);
+}
+.footer {
+    text-align: center;
+    margin-top: 40px;
+    font-size: 0.9em;
+    color: var(--secondary);
+}
+    </style>
+</head>
+<body>
+    <div class="header">
+        <h1>Mag-Picaro-12B</h1>
+        <p class="tagline">Picaro is all grown up...</p>
+        <img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/nqMkoIsmScaTFHCFirGsc.png" alt="Rei Model" class="model-img" width="500px">
+    </div>
+    <div class="card">
+        <h2>✨ Overview</h2>
+        <p>A scaled up version of Mag-Picaro, Funded by PygmalionAI as alternative to their Magnum Large option.</p>
+        <p>Fine-tuned on top of <a href="https://huggingface.co/Qwen/Qwen2-72B-Instruct" style="color: var(--accent);">Qwen-2-Instruct</a>, Mag-Picaro has been then slerp-merged at 50/50 weight with Magnum-V2.</p>
+    </div>
+    <div class="card">
+        <h2>📥 Quantized Models</h2>
+        <div class="quant-links">
+            <a href="" class="https://huggingface.co/mradermacher/MagPicaro-Big-i1-GGUF">GGUF Quant</a>
+            <a href="" class="https://huggingface.co/mradermacher/MagPicaro-Big-GGUF">Imatrix GGUF Quant</a>
+        </div>
+    </div>
+    <div class="card">
+        <h2>💬 Prompt Format</h2>
+        <p>Magpicaro uses the ChatML format. A typical conversation should be structured as:</p>
+        <pre><code>&lt;|im_start|>user
+Hi there!&lt;|im_end|>
+&lt;|im_start|>assistant
+Nice to meet you!&lt;|im_end|>
+&lt;|im_start|>user
+Can I ask a question?&lt;|im_end|>
+&lt;|im_start|>assistant</code></pre>
+        <h3>Recommended System Prompt</h3>
+        <div class="details">
+            <details>
+                <summary>View Euryale System Prompt</summary>
+                <p>Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.</p>
+            </details>
+        </div>
+    </div>
+    <div class="card">
+        <h2>⚙️ Training</h2>
+        <h3>Configuration</h3>
+        <div class="details">
+            <details>
+                <summary>View Axolotl Config</summary>
+                <p>https://wandb.ai/new-eden/tavbussy/artifacts/axolotl-config/config-n68z3imh/v0/files/axolotl_config_qhe749gq.yml</p>
+            </details>
+        </div>
+        <h3>Mergekit</h3>
+        <div class="details">
+            <details>
+                <summary>View Mergekit Config</summary>
+                <p>https://files.catbox.moe/gjaazp.yml</p>
+            </details>
+        </div>
+        <p>The model was trained for 4 epochs on 8x <a href="https://www.nvidia.com/en-us/data-center/h200/" style="color: var(--accent);">NVIDIA H200s</a> GPUs generously provided by @Tav</p>
+        <div class="badge-container">
+            <a href="https://github.com/OpenAccess-AI-Collective/axolotl">
+                <img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" class="badge">
+            </a>
+        </div>
+    </div>
+    <div class="card">
+        <h2>⚠️ Credits</h2>
+        <p><em>
+I'd like to thank, Ruka/Sama twinkman | LucyKnada | Kubernetes Bad | PocketDoc | Tav | Trappu | And the rest of Anthracite/Pygmalion for testing, feedback, and support.
+</em></p>
+    </div>
+    <div class="footer">
+        <p>Mag-Picaro | Big</p>
+    </div>
+</body>
+</html>