Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
roleplay
conversational
text-generation-inference
Instructions to use Vortex5/Ethereal-Stardust-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vortex5/Ethereal-Stardust-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Vortex5/Ethereal-Stardust-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Vortex5/Ethereal-Stardust-12B") model = AutoModelForCausalLM.from_pretrained("Vortex5/Ethereal-Stardust-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use Vortex5/Ethereal-Stardust-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Vortex5/Ethereal-Stardust-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Ethereal-Stardust-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Vortex5/Ethereal-Stardust-12B
- SGLang
How to use Vortex5/Ethereal-Stardust-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Vortex5/Ethereal-Stardust-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Ethereal-Stardust-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Vortex5/Ethereal-Stardust-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Ethereal-Stardust-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Vortex5/Ethereal-Stardust-12B with Docker Model Runner:
docker model run hf.co/Vortex5/Ethereal-Stardust-12B
| base_model: | |
| - Vortex5/Starlit-Shadow-12B | |
| - Vortex5/Wicked-Nebula-12B | |
| - Vortex5/Crimson-Constellation-12B | |
| - Vortex5/Nether-Moon-12B | |
| - Vortex5/Moonlit-Shadow-12B | |
| - Vortex5/Amber-Starlight-12B | |
| - Vortex5/Azure-Starlight-12B | |
| - Vortex5/Violet-Starlight-12B | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - roleplay | |
| license: apache-2.0 | |
| <section class="container"> | |
| <div class="header"> | |
| <h1 class="title-main">Ethereal-Stardust-12B</h1> | |
| </div> | |
| <div class="image-box"> | |
| <img src="cover.png" alt="Ethereal-Stardust-12B"> | |
| </div> | |
| <div class="divider"></div> | |
| <section class="card"> | |
| <h2 class="card-title">Overview</h2> | |
| <p> | |
| <strong class="highlight">Ethereal-Stardust-12B</strong> is a multi-stage merge combining | |
| <a href="https://huggingface.co/Vortex5/Starlit-Shadow-12B" class="link">Starlit-Shadow-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Wicked-Nebula-12B" class="link">Wicked-Nebula-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Crimson-Constellation-12B" class="link">Crimson-Constellation-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Nether-Moon-12B" class="link">Nether-Moon-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Moonlit-Shadow-12B" class="link">Moonlit-Shadow-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Amber-Starlight-12B" class="link">Amber-Starlight-12B</a>, | |
| <a href="https://huggingface.co/Vortex5/Azure-Starlight-12B" class="link">Azure-Starlight-12B</a>, | |
| and | |
| <a href="https://huggingface.co/Vortex5/Violet-Starlight-12B" class="link">Violet-Starlight-12B</a>. | |
| </p> | |
| <details class="config"> | |
| <summary>Multi-stage Merge Configuration</summary> | |
| <pre> | |
| name: First | |
| models: | |
| - model: Vortex5/Starlit-Shadow-12B | |
| - model: Vortex5/Wicked-Nebula-12B | |
| - model: Vortex5/Crimson-Constellation-12B | |
| - model: Vortex5/Nether-Moon-12B | |
| - model: Vortex5/Moonlit-Shadow-12B | |
| merge_method: saef | |
| chat_template: auto | |
| parameters: | |
| paradox: 0.42 | |
| strength: 0.89 | |
| boost: 0.33 | |
| modes: 2 | |
| dtype: float32 | |
| out_dtype: bfloat16 | |
| tokenizer: | |
| source: Vortex5/Nether-Moon-12B | |
| --- | |
| name: Second | |
| models: | |
| - model: Vortex5/Amber-Starlight-12B | |
| - model: Vortex5/Azure-Starlight-12B | |
| - model: Vortex5/Violet-Starlight-12B | |
| merge_method: saef | |
| chat_template: auto | |
| parameters: | |
| paradox: 0.46 | |
| strength: 0.9 | |
| boost: 0.45 | |
| modes: 2 | |
| dtype: float32 | |
| out_dtype: bfloat16 | |
| tokenizer: | |
| source: Vortex5/Nether-Moon-12B | |
| --- | |
| base_model: First | |
| models: | |
| - model: Second | |
| merge_method: hcr | |
| chat_template: auto | |
| parameters: | |
| strength: 0.5 | |
| retention: 0.6 | |
| novelty: 0.36 | |
| stability: 0.7 | |
| dtype: float32 | |
| out_dtype: bfloat16 | |
| tokenizer: | |
| source: Vortex5/Nether-Moon-12B | |
| </pre> | |
| </details> | |
| </section> | |
| <section class="card"> | |
| <h2 class="card-title">Intended Use</h2> | |
| <div class="grid"> | |
| <div class="tile"> | |
| <span class="tile-main">Roleplay</span> | |
| <span class="tile-sub">Character-driven interaction</span> | |
| </div> | |
| <div class="tile"> | |
| <span class="tile-main">Storytelling</span> | |
| <span class="tile-sub">Long-form narrative</span> | |
| </div> | |
| <div class="tile"> | |
| <span class="tile-main">Creative Writing</span> | |
| <span class="tile-sub">Atmospheric fiction</span> | |
| </div> | |
| </div> | |
| </section> | |
| <div class="divider"></div> | |
| </section> | |
| <style> | |
| .container{ | |
| --bg: #0a001f; | |
| --panel: #1e0f3a; | |
| --panel2: #2d1a55; | |
| --accent-pink: #ff3ba0; | |
| --accent-cyan: #1e9fd1; | |
| --accent-violet: #c44eff; | |
| --accent-fuchsia: #ff4dd4; | |
| --text: #f8f4ff; | |
| --text-dim: #d4b8ff; | |
| --grad: linear-gradient(90deg, var(--accent-pink), var(--accent-cyan), var(--accent-violet)); | |
| max-width: 1100px; | |
| margin: 60px auto; | |
| padding: 56px 52px; | |
| position: relative; | |
| overflow: hidden; | |
| border: 3px solid rgba(255, 59, 160, 0.25); | |
| border-radius: 4px; | |
| background: | |
| linear-gradient(135deg, #0a001f 0%, #1a0b38 40%, #2d1a55 70%, #0f0033 100%), | |
| radial-gradient(circle at 15% 20%, rgba(255, 59, 160, 0.18) 0%, transparent 50%), | |
| radial-gradient(circle at 85% 75%, rgba(30, 159, 209, 0.14) 0%, transparent 50%), | |
| radial-gradient(circle at 40% 80%, rgba(196, 78, 255, 0.15) 0%, transparent 45%), | |
| radial-gradient(circle at 70% 15%, rgba(255, 77, 212, 0.13) 0%, transparent 55%), | |
| repeating-radial-gradient(circle at 25% 30%, rgba(255,255,255,0.9) 1px, transparent 2px), | |
| repeating-radial-gradient(circle at 75% 70%, rgba(30,159,209,0.75) 1px, transparent 2px), | |
| repeating-radial-gradient(circle at 45% 15%, rgba(255,59,160,0.85) 1px, transparent 2px); | |
| background-size: 200% 200%, 300% 300%, 250% 250%, 280% 280%, 80px 80px, 95px 95px, 110px 110px; | |
| color: var(--text); | |
| font-family: "Cinzel", "Georgia", "Times New Roman", serif; | |
| display: flex; | |
| flex-direction: column; | |
| gap: 42px; | |
| box-shadow: | |
| inset 0 0 80px -30px rgba(196, 78, 255, 0.25); | |
| animation: nebula-drift 120s linear infinite; | |
| } | |
| @keyframes nebula-drift { | |
| 0% { background-position: 0% 50%, 100% 50%, 0% 100%, 100% 0%, 0 0, 0 0, 0 0; } | |
| 100% { background-position: 100% 50%, 0% 50%, 100% 0%, 0% 100%, 0 0, 0 0, 0 0; } | |
| } | |
| .container::before { | |
| content: ""; | |
| position: absolute; | |
| inset: 0; | |
| pointer-events: none; | |
| background: | |
| radial-gradient(circle, rgba(255,255,255,0.95) 1px, transparent 0), | |
| radial-gradient(circle, rgba(30,159,209,0.8) 1.5px, transparent 0), | |
| radial-gradient(circle, rgba(255,59,160,0.9) 1px, transparent 0); | |
| background-size: 120px 120px, 180px 180px, 90px 90px; | |
| animation: stardust-twinkle 4s linear infinite; | |
| opacity: 0.72; | |
| z-index: 1; | |
| mix-blend-mode: screen; | |
| } | |
| @keyframes stardust-twinkle { | |
| 0%, 100% { opacity: 0.65; } | |
| 50% { opacity: 0.92; } | |
| } | |
| .header { | |
| position: relative; | |
| z-index: 2; | |
| display: flex; | |
| justify-content: center; | |
| align-items: center; | |
| text-align: center; | |
| padding: 32px 0 36px; | |
| border-bottom: 2px solid rgba(255, 77, 212, 0.3); | |
| background: linear-gradient(90deg, | |
| rgba(255,59,160,0.08), | |
| rgba(30,159,209,0.08), | |
| rgba(196,78,255,0.08)); | |
| } | |
| .title-main { | |
| margin: 0; | |
| font-size: clamp(1.15rem, 3.1vw, 2.15rem); | |
| font-weight: 900; | |
| letter-spacing: 0.09em; | |
| text-transform: uppercase; | |
| line-height: 1.05; | |
| background: linear-gradient(90deg, | |
| #ff3ba0, | |
| #1e9fd1, | |
| #c44eff, | |
| #ff4dd4); | |
| -webkit-background-clip: text; | |
| background-clip: text; | |
| color: transparent; | |
| text-shadow: | |
| 0 0 18px rgba(255, 59, 160, 0.75), | |
| 0 0 35px rgba(30, 159, 209, 0.55); | |
| position: relative; | |
| } | |
| .image-box { | |
| position: relative; | |
| z-index: 2; | |
| display: flex; | |
| justify-content: center; | |
| padding: 12px 0 28px; | |
| } | |
| .image-box img { | |
| width: 100%; | |
| max-width: 860px; | |
| border: 4px solid rgba(255, 77, 212, 0.35); | |
| box-shadow: | |
| 0 20px 0 rgba(10, 0, 31, 0.9), | |
| 0 0 50px 15px rgba(255, 59, 160, 0.4), | |
| 0 0 80px 25px rgba(30, 159, 209, 0.25); | |
| border-radius: 4px; | |
| } | |
| .divider { | |
| position: relative; | |
| z-index: 2; | |
| height: 3px; | |
| width: 100%; | |
| background: var(--grad); | |
| box-shadow: 0 0 30px 8px rgba(255, 77, 212, 0.4); | |
| border-radius: 0; | |
| opacity: 0.9; | |
| } | |
| .card { | |
| position: relative; | |
| z-index: 2; | |
| background: linear-gradient(135deg, rgba(30,15,58,0.96), rgba(45,26,85,0.96)); | |
| padding: 40px 46px; | |
| border: 3px solid rgba(255, 59, 160, 0.25); | |
| border-radius: 4px; | |
| box-shadow: | |
| 0 15px 0 rgba(10,0,31,0.9); | |
| } | |
| .card-title { | |
| margin: 0 0 24px; | |
| font-size: 1.55rem; | |
| letter-spacing: 0.15em; | |
| text-transform: uppercase; | |
| color: #ff4dd4; | |
| text-shadow: 0 0 15px rgba(255, 77, 212, 0.6); | |
| } | |
| .card p { | |
| margin: 16px 0 28px; | |
| line-height: 1.82; | |
| color: var(--text-dim); | |
| font-family: "Inter", "Segoe UI", sans-serif; | |
| font-size: 1.05rem; | |
| } | |
| .highlight { | |
| color: #ff3ba0; | |
| font-weight: 800; | |
| text-shadow: 0 0 12px rgba(255, 59, 160, 0.5); | |
| } | |
| .link { | |
| color: #1e9fd1; | |
| text-decoration: none; | |
| font-weight: 700; | |
| transition: all 0.3s ease; | |
| } | |
| .link:hover { | |
| color: #ff4dd4; | |
| text-shadow: 0 0 12px rgba(255, 77, 212, 0.7); | |
| text-decoration: underline; | |
| } | |
| .config { | |
| margin-top: 26px; | |
| border: 2px solid rgba(255, 77, 212, 0.3); | |
| background: rgba(15, 5, 35, 0.95); | |
| border-radius: 4px; | |
| overflow: hidden; | |
| box-shadow: 0 0 25px rgba(255, 77, 212, 0.2); | |
| } | |
| .config summary { | |
| padding: 18px 26px; | |
| cursor: pointer; | |
| font-size: 0.95rem; | |
| text-transform: uppercase; | |
| letter-spacing: 0.12em; | |
| font-weight: 900; | |
| color: #ff4dd4; | |
| background: linear-gradient(90deg, #2d1a55, #1e0f3a); | |
| } | |
| .config pre { | |
| margin: 0; | |
| padding: 28px 30px; | |
| font-family: ui-monospace, Consolas, monospace; | |
| font-size: 0.86rem; | |
| background: #110833; | |
| color: #e0c8ff; | |
| line-height: 1.65; | |
| overflow-x: auto; | |
| } | |
| .grid { | |
| display: flex; | |
| gap: 24px; | |
| flex-wrap: wrap; | |
| margin-top: 16px; | |
| } | |
| .tile { | |
| flex: 1 1 200px; | |
| padding: 28px 24px; | |
| background: linear-gradient(135deg, rgba(45,26,85,0.9), rgba(30,15,58,0.9)); | |
| border: 2px solid rgba(196,78,255,0.3); | |
| text-align: center; | |
| border-radius: 4px; | |
| transition: all 0.4s cubic-bezier(0.4, 0, 0.2, 1); | |
| } | |
| .tile:hover { | |
| transform: translateY(-6px) scale(1.04); | |
| border-color: #ff3ba0; | |
| box-shadow: 0 0 30px 12px rgba(255, 59, 160, 0.35); | |
| } | |
| .tile-main { | |
| display: block; | |
| font-weight: 900; | |
| text-transform: uppercase; | |
| letter-spacing: 0.1em; | |
| color: #1e9fd1; | |
| margin-bottom: 10px; | |
| font-size: 1.1rem; | |
| } | |
| .tile-sub { | |
| font-size: 0.96rem; | |
| color: var(--text-dim); | |
| font-family: "Inter", "Segoe UI", sans-serif; | |
| } | |
| @media (max-width: 600px) { | |
| .container { | |
| margin: 30px 12px; | |
| padding: 36px 24px; | |
| } | |
| .card { | |
| padding: 32px 28px; | |
| } | |
| .tile { | |
| flex: 1 1 100%; | |
| } | |
| } | |
| </style> |