| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="UTF-8"> | |
| <meta name="viewport" content="width=device-width, initial-scale=1.0"> | |
| <title>Sol-Reaver 15B</title> | |
| <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> | |
| <style> | |
| body { | |
| font-family: 'Quicksand', sans-serif; | |
| background: linear-gradient(135deg, #ffeef8 0%, #fff0e6 50%, #f8e8ff 100%); | |
| color: #8b4a6b; | |
| margin: 0; | |
| padding: 0; | |
| font-size: 16px; | |
| min-height: 100vh; | |
| } | |
| .container { | |
| margin: 20px; | |
| background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(255, 245, 250, 0.95)); | |
| padding: 30px; | |
| border-radius: 20px; | |
| box-shadow: 0 8px 32px rgba(255, 182, 193, 0.3), 0 4px 16px rgba(255, 215, 0, 0.2); | |
| border: 2px solid rgba(255, 182, 193, 0.4); | |
| position: relative; | |
| backdrop-filter: blur(10px); | |
| } | |
| .container::before { | |
| content: ''; | |
| position: absolute; | |
| top: 0; | |
| left: 0; | |
| right: 0; | |
| bottom: 0; | |
| background: linear-gradient(45deg, rgba(255, 192, 203, 0.1), rgba(255, 215, 0, 0.1), rgba(221, 160, 221, 0.1)); | |
| border-radius: 20px; | |
| z-index: -1; | |
| } | |
| .header h1 { | |
| font-size: 32px; | |
| background: linear-gradient(45deg, #d63384, #fd7e14, #e91e63); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 20px 0; | |
| text-align: center; | |
| font-weight: 600; | |
| text-shadow: 0 2px 4px rgba(255, 182, 193, 0.3); | |
| } | |
| .section { | |
| margin-top: 30px; | |
| } | |
| .section h2 { | |
| font-size: 24px; | |
| background: linear-gradient(45deg, #d63384, #fd7e14); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| text-align: center; | |
| font-weight: 600; | |
| margin-bottom: 20px; | |
| } | |
| .info p { | |
| color: #8b4a6b; | |
| line-height: 1.8; | |
| font-size: 16px; | |
| } | |
| .info img { | |
| width: 85%; | |
| border-radius: 15px; | |
| margin: 0 auto 15px; | |
| display: block; | |
| box-shadow: 0 8px 25px rgba(255, 182, 193, 0.4); | |
| border: 2px solid rgba(255, 192, 203, 0.5); | |
| } | |
| a { | |
| color: #d63384; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| font-weight: 500; | |
| } | |
| a:hover { | |
| color: #fd7e14; | |
| text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); | |
| } | |
| .button { | |
| display: inline-block; | |
| background: linear-gradient(45deg, #ffb6c1, #ffd700); | |
| color: #8b4a6b; | |
| padding: 12px 24px; | |
| border-radius: 25px; | |
| cursor: pointer; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| border: 1px solid rgba(255, 182, 193, 0.5); | |
| font-weight: 500; | |
| } | |
| .button:hover { | |
| background: linear-gradient(45deg, #ff91a4, #ffed4e); | |
| box-shadow: 0 4px 15px rgba(255, 182, 193, 0.6); | |
| transform: translateY(-2px); | |
| } | |
| pre { | |
| background: linear-gradient(135deg, rgba(255, 240, 245, 0.8), rgba(255, 248, 220, 0.8)); | |
| padding: 20px; | |
| border-radius: 12px; | |
| overflow-x: auto; | |
| border: 1px solid rgba(255, 182, 193, 0.3); | |
| box-shadow: inset 0 2px 4px rgba(255, 182, 193, 0.2); | |
| } | |
| code { | |
| font-family: 'Courier New', monospace; | |
| color: #8b4a6b; | |
| } | |
| .info-card { | |
| background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); | |
| border: 2px solid rgba(255, 182, 193, 0.4); | |
| border-radius: 15px; | |
| overflow: hidden; | |
| box-shadow: 0 4px 20px rgba(255, 182, 193, 0.3); | |
| } | |
| .info-header { | |
| background: linear-gradient(135deg, rgba(255, 192, 203, 0.3), rgba(255, 215, 0, 0.2)); | |
| padding: 25px; | |
| border-bottom: 1px solid rgba(255, 182, 193, 0.3); | |
| } | |
| .info-header h3 { | |
| background: linear-gradient(45deg, #d63384, #fd7e14); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 15px 0; | |
| font-size: 22px; | |
| text-align: center; | |
| font-weight: 600; | |
| } | |
| .model-tags { | |
| display: flex; | |
| gap: 10px; | |
| flex-wrap: wrap; | |
| justify-content: center; | |
| } | |
| .model-tag { | |
| background: linear-gradient(45deg, rgba(255, 182, 193, 0.4), rgba(255, 215, 0, 0.3)); | |
| color: #8b4a6b; | |
| padding: 8px 16px; | |
| border-radius: 20px; | |
| font-size: 13px; | |
| border: 1px solid rgba(255, 182, 193, 0.5); | |
| font-weight: 500; | |
| box-shadow: 0 2px 8px rgba(255, 182, 193, 0.2); | |
| } | |
| .model-composition { | |
| padding: 25px; | |
| border-bottom: 1px solid rgba(255, 182, 193, 0.3); | |
| } | |
| .model-composition h4 { | |
| background: linear-gradient(45deg, #d63384, #fd7e14); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 20px 0; | |
| font-size: 18px; | |
| text-align: center; | |
| font-weight: 600; | |
| } | |
| .composition-list { | |
| list-style: none; | |
| padding: 0; | |
| margin: 0; | |
| display: grid; | |
| gap: 15px; | |
| } | |
| .composition-list li { | |
| color: #8b4a6b; | |
| display: flex; | |
| align-items: baseline; | |
| gap: 12px; | |
| padding: 10px; | |
| background: rgba(255, 240, 245, 0.5); | |
| border-radius: 8px; | |
| border-left: 4px solid #ffb6c1; | |
| } | |
| .model-component { | |
| font-weight: 600; | |
| min-width: 120px; | |
| } | |
| .model-description { | |
| padding: 25px; | |
| background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(255, 240, 245, 0.8)); | |
| } | |
| .metrics-section { | |
| margin-bottom: 30px; | |
| } | |
| .metrics-section details { | |
| background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); | |
| border: 2px solid rgba(255, 182, 193, 0.4); | |
| border-radius: 12px; | |
| padding: 20px; | |
| margin-bottom: 20px; | |
| box-shadow: 0 4px 15px rgba(255, 182, 193, 0.2); | |
| } | |
| .metrics-section summary { | |
| background: linear-gradient(45deg, #d63384, #fd7e14); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| font-size: 18px; | |
| cursor: pointer; | |
| outline: none; | |
| padding: 8px 0; | |
| text-align: center; | |
| font-weight: 600; | |
| transition: all 0.3s ease; | |
| } | |
| .metrics-section summary:hover { | |
| text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); | |
| } | |
| .creator-section { | |
| margin: 20px 0; | |
| text-align: center; | |
| } | |
| .creator-badge { | |
| display: inline-flex; | |
| align-items: center; | |
| background: linear-gradient(145deg, rgba(255, 240, 245, 0.9), rgba(255, 248, 220, 0.9)); | |
| border: 2px solid rgba(255, 182, 193, 0.4); | |
| border-radius: 25px; | |
| padding: 15px 20px; | |
| box-shadow: 0 4px 15px rgba(255, 182, 193, 0.3); | |
| } | |
| .creator-label { | |
| color: #8b4a6b; | |
| font-size: 14px; | |
| margin-right: 10px; | |
| font-weight: 500; | |
| } | |
| .creator-link { | |
| display: flex; | |
| align-items: center; | |
| gap: 8px; | |
| color: #d63384; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| } | |
| .creator-name { | |
| font-weight: 600; | |
| } | |
| .creator-arrow { | |
| font-size: 16px; | |
| transition: transform 0.3s ease; | |
| } | |
| .creator-link:hover .creator-arrow { | |
| transform: translateX(4px); | |
| color: #fd7e14; | |
| } | |
| .creator-link:hover { | |
| color: #fd7e14; | |
| text-shadow: 0 0 8px rgba(255, 215, 0, 0.6); | |
| } | |
| .link-arrow { | |
| display: inline-block; | |
| transition: transform 0.3s ease; | |
| } | |
| a:hover .link-arrow { | |
| transform: translateX(3px); | |
| } | |
| .axolotl-container { | |
| display: flex; | |
| text-align: center; /* This is correctly applied to center the image itself */ | |
| justify-content: center; | |
| margin: 30px 0; | |
| } | |
| .axolotl-container img { | |
| max-width: 300px; | |
| border-radius: 15px; | |
| box-shadow: 0 6px 20px rgba(255, 182, 193, 0.4); | |
| border: 2px solid rgba(255, 192, 203, 0.5); | |
| transition: transform 0.3s ease; | |
| display: block; /* Make the image a block element */ | |
| margin: 0 auto; /* Center it horizontally within its parent */ | |
| } | |
| .axolotl-container img:hover { | |
| transform: scale(1.05); | |
| } | |
| </style> | |
| </head> | |
| <body> | |
| <div class="container"> | |
| <div class="header"> | |
| <h1>Sol Reaver 15B</h1> | |
| </div> | |
| <div class="info"> | |
| <img src="https://cdn-uploads.huggingface.co/production/uploads/66c26b6fb01b19d8c3c2467b/DYgyLUEaHAv9kTffBYH-F.jpeg" alt="Model banner"> | |
| <div style="text-align: center;"> | |
| <div class="creator-section"> | |
| <div class="creator-badge"> | |
| <span class="creator-label">Created by</span> | |
| <a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link"> | |
| <span class="creator-name">Delta-Vector</span> | |
| <span class="creator-arrow">→</span> | |
| </a> | |
| </div> | |
| </div> | |
| <div class="model-info"> | |
| <h2>Model Information</h2> | |
| <div class="info-card"> | |
| <div class="info-header"> | |
| <h3>Sol-Reaver-15B-Instruct</h3> | |
| <div class="model-tags"> | |
| <span class="model-tag">15B parameters</span> | |
| <span class="model-tag">Creative / Fresh Prose</span> | |
| <span class="model-tag">Co-writing/Roleplay/Adventure Generalist</span> | |
| </div> | |
| </div> | |
| <div class="model-description"> | |
| <p>The first in the line of a New series of Roleplay / Adventure / Co-writer Models - Finetuned ontop of Sol-Reaver-15B-Pretrain</p> | |
| <p>This model has been trained on 200M tokens of high quality Instruct data, It's focus is to provide a base for further finetuning|Merging</p> | |
| <p>It's goal is to have refreshing Prose, Creativity, Good Instruct following and the *Brains*.</p> | |
| </div> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Quantized Versions</h2> | |
| <div class="info-card"> | |
| <div class="model-composition"> | |
| <h4>Available Downloads</h4> | |
| <ul class="composition-list"> | |
| <li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li> | |
| <li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li> | |
| <li><span class="model-component"><a href="" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li> | |
| </ul> | |
| </div> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Prompting</h2> | |
| <p>Model has been tuned with the ChatML formatting. A typical input would look like this:</p> | |
| <pre><code><|im_start|>user | |
| Hi there!<|im_end|> | |
| <|im_start|>assistant | |
| Nice to meet you!<|im_end|> | |
| <|im_start|>user | |
| Can I ask a question?<|im_end|> | |
| <|im_start|>assistant | |
| </code></pre> | |
| </div> | |
| <div class="section"> | |
| <h2>Samplers</h2> | |
| <p>For testing of this model, I used Temp=1, 0.1 Min-P.</p> | |
| <div class="metrics-section"> | |
| <details> | |
| <summary>See Axolotl Config</summary> | |
| <pre><code> | |
| https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-7d4ecudg/v0/files/axolotl_config_avyx566_.yml | |
| </code></pre> | |
| </details> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Training</h2> | |
| <p>The training was done for 2 epoch using 8 x <a href="https://www.nvidia.com/en-us/data-center/h200/">H200s</a> GPUs graciously provided by <a href="https://huggingface.co/kalomaze">Kalomaze</a> for the fine-tuning of the model.</p> | |
| <div class="axolotl-container"> | |
| <a href="https://github.com/OpenAccess-AI-Collective/axolotl" target="_blank"> | |
| <img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl"> | |
| </a> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Credits</h2> | |
| <p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/Ateron">Ateron</a>, <a href="https://huggingface.co/AliCat2">Alicat</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p> | |
| </div> | |
| </div> | |
| </div> | |
| </body> | |
| </html> |