Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
roleplay
conversational
text-generation-inference
Instructions to use Vortex5/Silver-Siren-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vortex5/Silver-Siren-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Vortex5/Silver-Siren-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Vortex5/Silver-Siren-12B") model = AutoModelForCausalLM.from_pretrained("Vortex5/Silver-Siren-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Vortex5/Silver-Siren-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Vortex5/Silver-Siren-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Silver-Siren-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Vortex5/Silver-Siren-12B
- SGLang
How to use Vortex5/Silver-Siren-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Vortex5/Silver-Siren-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Silver-Siren-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Vortex5/Silver-Siren-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Silver-Siren-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Vortex5/Silver-Siren-12B with Docker Model Runner:
docker model run hf.co/Vortex5/Silver-Siren-12B
| base_model: | |
| - Vortex5/Stellar-Witch-12B | |
| - Vortex5/Elysian-Sunrise-12B | |
| - Vortex5/LunaMaid-12B | |
| - Vortex5/Shining-Prism-12B | |
| - ReadyArt/Dark-Nexus-12B-v2.0 | |
| - allura-org/Tlacuilo-12B | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - roleplay | |
| license: apache-2.0 | |
| <section class="model-card"> | |
| <div class="header"> | |
| <div class="title-frame"> | |
| <h1 class="title">Silver-Siren-12B</h1> | |
| </div> | |
| </div> | |
| <div class="image-container"> | |
| <img src="cover.png"> | |
| </div> | |
| <div class="divider"></div> | |
| <section class="box"> | |
| <h2 class="box-title">Overview</h2> | |
| <p> | |
| <strong class="highlight">Silver-Siren-12B</strong> was created through a multi-stage merge combining | |
| <a href="https://huggingface.co/Vortex5/Stellar-Witch-12B" class="link">Stellar-Witch-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Elysian-Sunrise-12B" class="link">Elysian-Sunrise-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/LunaMaid-12B" class="link">LunaMaid-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Shining-Prism-12B" class="link">Shining-Prism-12B</a>, | |
| <a href="https://huggingface.co/ReadyArt/Dark-Nexus-12B-v2.0" class="link">Dark-Nexus-12B-v2.0</a>, and | |
| <a href="https://huggingface.co/allura-org/Tlacuilo-12B" class="link">Tlacuilo-12B.</a> | |
| </p> | |
| <details class="collapse"> | |
| <summary>Multi-stage merge configuration</summary> | |
| <pre> | |
| name: First | |
| base_model: Vortex5/Stellar-Witch-12B | |
| models: | |
| - model: Vortex5/Elysian-Sunrise-12B | |
| merge_method: slerp | |
| parameters: | |
| t: 0.5 | |
| dtype: float32 | |
| tokenizer: | |
| source: Vortex5/Stellar-Witch-12B | |
| --- | |
| name: Second | |
| base_model: Vortex5/LunaMaid-12B | |
| models: | |
| - model: Vortex5/Shining-Prism-12B | |
| - model: ReadyArt/Dark-Nexus-12B-v2.0 | |
| - model: allura-org/Tlacuilo-12B | |
| merge_method: nexus | |
| dtype: float32 | |
| tokenizer: | |
| source: Vortex5/LunaMaid-12B | |
| --- | |
| models: | |
| - model: First | |
| - model: Second | |
| merge_method: karcher | |
| chat_template: auto | |
| dtype: float32 | |
| out_dtype: bfloat16 | |
| parameters: | |
| tol: 1e-9 | |
| max_iter: 1000 | |
| tokenizer: | |
| source: Vortex5/LunaMaid-12B | |
| </pre> | |
| </details> | |
| </section> | |
| <section class="box last-box"> | |
| <h2 class="box-title">Intended Use</h2> | |
| <div class="grid"> | |
| <div class="tile"> | |
| <span class="tile-main">Roleplay</span> | |
| <span class="tile-sub">Emotion-forward interaction</span> | |
| </div> | |
| <div class="tile"> | |
| <span class="tile-main">Storytelling</span> | |
| <span class="tile-sub">Atmospheric long-form narrative</span> | |
| </div> | |
| <div class="tile"> | |
| <span class="tile-main">Creative Writing</span> | |
| <span class="tile-sub">Atmospheric fiction</span> | |
| </div> | |
| </div> | |
| </section> | |
| <div class="divider"></div> | |
| <div class="ocean-waves"> | |
| <svg width="100%" height="65" viewBox="0 0 1200 120" preserveAspectRatio="none"> | |
| <path d="M0,50 C300,90 550,10 850,50 C1000,75 1100,35 1200,55 L1200,120 L0,120 Z" fill="#0f766e" opacity="0.35"/> | |
| <path d="M0,35 C280,75 520,5 780,40 C950,65 1080,25 1200,48 L1200,120 L0,120 Z" fill="#14b8a6" opacity="0.22"/> | |
| <path d="M0,45 C320,85 580,15 820,48 C980,70 1090,30 1200,52 L1200,120 L0,120 Z" fill="#67e8f9" opacity="0.12"/> | |
| </svg> | |
| </div> | |
| </section> | |
| <style> | |
| .model-card { | |
| max-width: 1100px; | |
| margin: 40px auto; | |
| padding: 52px 40px 60px; | |
| font-family: "Georgia", "Times New Roman", serif; | |
| color: #e0e7ff; | |
| background: | |
| radial-gradient(circle at 22% 18%, rgba(20, 184, 166, 0.07) 0%, transparent 48%), | |
| radial-gradient(circle at 78% 82%, rgba(103, 232, 249, 0.05) 0%, transparent 52%), | |
| #0a1428; | |
| border: 4px solid #b8c4d4; | |
| border-radius: 16px; | |
| position: relative; | |
| overflow: hidden; | |
| } | |
| .model-card::before { | |
| content: ''; | |
| position: absolute; | |
| inset: 0; | |
| background-image: | |
| radial-gradient(circle, #c0c7d1 1.1px, transparent 1.1px), | |
| radial-gradient(circle, #67e8f9 0.85px, transparent 0.85px), | |
| radial-gradient(circle, #94a3b8 1.35px, transparent 1.35px); | |
| background-position: 0 0, 38px 32px, 72px 18px, 95px 75px, 22px 105px; | |
| background-size: 95px 95px, 120px 105px, 80px 115px, 108px 88px, 68px 78px; | |
| opacity: 0.11; | |
| pointer-events: none; | |
| z-index: 0; | |
| animation: ocean-sparkle 24s linear infinite; | |
| } | |
| @keyframes ocean-sparkle { | |
| 0%, 100% { opacity: 0.11; } | |
| 50% { opacity: 0.18; } | |
| } | |
| .header { | |
| text-align: center; | |
| padding-bottom: 18px; | |
| position: relative; | |
| z-index: 2; | |
| } | |
| .title-frame { | |
| display: inline-block; | |
| position: relative; | |
| padding: 8px 42px; | |
| background: rgba(15, 23, 42, 0.55); | |
| border: 2px solid #b8c4d4; | |
| border-radius: 12px; | |
| box-shadow: | |
| inset 0 2px 6px rgba(255,255,255,0.12), | |
| 0 12px 35px rgba(15, 23, 42, 0.55); | |
| } | |
| .title { | |
| margin: 0; | |
| font-size: clamp(1.85rem, 4.4vw, 2.65rem); | |
| font-weight: 900; | |
| letter-spacing: 0.12em; | |
| text-transform: uppercase; | |
| color: #e2e8f0; | |
| text-shadow: | |
| 0 0 8px rgba(192, 200, 210, 0.85), | |
| 0 0 18px rgba(103, 232, 249, 0.35), | |
| 0 5px 14px rgba(15, 23, 42, 0.9); | |
| line-height: 1.05; | |
| } | |
| .image-container { | |
| display: flex; | |
| justify-content: center; | |
| position: relative; | |
| z-index: 2; | |
| margin-bottom: 32px; | |
| } | |
| .image-container img { | |
| width: 100%; | |
| max-width: 820px; | |
| border-radius: 12px; | |
| border: 4px solid #b8c4d4; | |
| box-shadow: | |
| 0 35px 80px -22px rgba(15, 23, 42, 0.75), | |
| 0 0 35px -8px rgba(20, 184, 166, 0.25); | |
| } | |
| .divider { | |
| height: 3px; | |
| margin: 42px 0; | |
| background: linear-gradient(90deg, | |
| transparent, | |
| #64748b 18%, | |
| #14b8a6 50%, | |
| #64748b 82%, | |
| transparent | |
| ); | |
| box-shadow: 0 0 14px rgba(20, 184, 166, 0.25); | |
| position: relative; | |
| z-index: 2; | |
| } | |
| .box { | |
| padding: 36px; | |
| background: rgba(15, 23, 42, 0.96); | |
| border: 2px solid #94a3b8; | |
| border-radius: 12px; | |
| box-shadow: | |
| inset 0 5px 0 rgba(226, 232, 240, 0.06), | |
| 0 22px 55px -18px rgba(15, 23, 42, 0.65); | |
| position: relative; | |
| z-index: 2; | |
| backdrop-filter: blur(10px); | |
| margin-bottom: 32px; | |
| } | |
| .last-box { | |
| margin-bottom: 0; | |
| } | |
| .box-title { | |
| margin: 0 0 24px; | |
| font-size: 1.18rem; | |
| font-weight: 800; | |
| letter-spacing: 0.26em; | |
| text-transform: uppercase; | |
| color: #cbd5e1; | |
| border-bottom: 3px solid #14b8a6; | |
| padding-bottom: 13px; | |
| display: inline-block; | |
| text-shadow: 0 0 10px rgba(20, 184, 166, 0.35); | |
| } | |
| .box p { | |
| margin: 16px 0 20px; | |
| line-height: 1.82; | |
| color: #cbd5e1; | |
| font-size: 1.05rem; | |
| } | |
| .highlight { | |
| color: #67e8f9; | |
| font-weight: 700; | |
| text-shadow: 0 0 12px rgba(103, 232, 249, 0.45); | |
| } | |
| .collapse { | |
| margin-top: 28px; | |
| background: rgba(10, 15, 30, 0.96); | |
| border: 2px solid #64748b; | |
| border-radius: 10px; | |
| overflow: hidden; | |
| } | |
| .collapse summary { | |
| padding: 18px 26px; | |
| cursor: pointer; | |
| font-size: 0.88rem; | |
| font-weight: 700; | |
| letter-spacing: 0.18em; | |
| text-transform: uppercase; | |
| color: #cbd5e1; | |
| background: rgba(15, 23, 42, 0.92); | |
| border-bottom: 2px solid #14b8a6; | |
| } | |
| .collapse pre { | |
| margin: 0; | |
| padding: 26px; | |
| background: #0f172a; | |
| color: #94a3b8; | |
| font-size: 0.87rem; | |
| line-height: 1.72; | |
| font-family: ui-monospace, SFMono-Regular, Menlo, Monaco, Consolas, "Liberation Mono", "Courier New", monospace; | |
| text-align: left; | |
| overflow-x: auto; | |
| } | |
| .grid { | |
| display: flex; | |
| flex-wrap: wrap; | |
| gap: 22px; | |
| margin-top: 18px; | |
| } | |
| .tile { | |
| flex: 1 1 245px; | |
| padding: 26px 22px; | |
| background: rgba(15, 23, 42, 0.94); | |
| border: 2px solid #64748b; | |
| border-radius: 10px; | |
| text-align: center; | |
| transition: all 0.35s cubic-bezier(0.23, 1, 0.32, 1); | |
| } | |
| .tile:hover { | |
| transform: translateY(-7px) scale(1.02); | |
| border-color: #14b8a6; | |
| box-shadow: 0 20px 50px -15px rgba(20, 184, 166, 0.35); | |
| } | |
| .tile-main { | |
| display: block; | |
| margin-bottom: 10px; | |
| font-size: 1.12rem; | |
| font-weight: 800; | |
| letter-spacing: 0.1em; | |
| text-transform: uppercase; | |
| color: #e0e7ff; | |
| } | |
| .tile-sub { | |
| display: block; | |
| font-size: 0.93rem; | |
| color: #64748b; | |
| line-height: 1.5; | |
| } | |
| .link { | |
| color: #94a3b8; | |
| text-decoration: none; | |
| transition: color 0.3s ease; | |
| } | |
| .link:hover { | |
| color: #67e8f9; | |
| text-decoration: underline; | |
| } | |
| .ocean-waves { | |
| position: absolute; | |
| bottom: 0; | |
| left: 0; | |
| width: 100%; | |
| height: 65px; | |
| overflow: hidden; | |
| pointer-events: none; | |
| z-index: 1; | |
| opacity: 0.65; | |
| } | |
| .ocean-waves svg { | |
| display: block; | |
| animation: gentle-wave 9s ease-in-out infinite; | |
| } | |
| @keyframes gentle-wave { | |
| 0%, 100% { transform: translateX(0); } | |
| 50% { transform: translateX(-18px); } | |
| } | |
| @media (max-width: 680px) { | |
| .model-card { | |
| padding: 36px 24px 46px; | |
| margin: 20px 12px; | |
| border-radius: 14px; | |
| } | |
| .box { | |
| padding: 26px; | |
| } | |
| .title { | |
| font-size: 1.75rem; | |
| letter-spacing: 0.09em; | |
| } | |
| } | |
| </style> |