Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
roleplay
conversational
text-generation-inference
Instructions to use Vortex5/Mythic-Fabulist-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vortex5/Mythic-Fabulist-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Vortex5/Mythic-Fabulist-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Vortex5/Mythic-Fabulist-12B") model = AutoModelForCausalLM.from_pretrained("Vortex5/Mythic-Fabulist-12B") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Vortex5/Mythic-Fabulist-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Vortex5/Mythic-Fabulist-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Mythic-Fabulist-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Vortex5/Mythic-Fabulist-12B
- SGLang
How to use Vortex5/Mythic-Fabulist-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Vortex5/Mythic-Fabulist-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Mythic-Fabulist-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Vortex5/Mythic-Fabulist-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Mythic-Fabulist-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Vortex5/Mythic-Fabulist-12B with Docker Model Runner:
docker model run hf.co/Vortex5/Mythic-Fabulist-12B
| base_model: | |
| - ReadyArt/Omega-Darker_The-Final-Directive-12B | |
| - crestf411/nemo-sunfall-v0.6.1 | |
| - nbeerbower/Lyra4-Gutenberg-12B | |
| - Delta-Vector/Rei-V3-KTO-12B | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - roleplay | |
| license: apache-2.0 | |
| <section class="wrapper"> | |
| <div class="top"> | |
| <h1 class="heading">Mythic-Fabulist-12B</h1> | |
| </div> | |
| <div class="media"> | |
| <img src="cover.png"> | |
| </div> | |
| <div class="line"></div> | |
| <section class="panel"> | |
| <h2 class="panel-heading">Overview</h2> | |
| <p> | |
| <strong class="accent">Mythic-Fabulist-12B</strong> is a multi-stage merge combining | |
| <a href="https://huggingface.co/ReadyArt/Omega-Darker_The-Final-Directive-12B" class="text-link">Omega-Darker The Final Directive-12B</a>, | |
| <a href="https://huggingface.co/crestf411/nemo-sunfall-v0.6.1" class="text-link">nemo-sunfall-v0.6.1</a>, | |
| <a href="https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B" class="text-link">Lyra4-Gutenberg-12B</a>, | |
| and | |
| <a href="https://huggingface.co/Delta-Vector/Rei-V3-KTO-12B" class="text-link">Rei-V3-KTO-12B</a>. | |
| </p> | |
| <details class="toggle"> | |
| <summary>Multi-stage Merge Configuration</summary> | |
| <pre> | |
| name: First | |
| models: | |
| - model: ReadyArt/Omega-Darker_The-Final-Directive-12B | |
| merge_method: nearswap | |
| base_model: crestf411/nemo-sunfall-v0.6.1 | |
| parameters: | |
| t: 0.0008 | |
| dtype: float32 | |
| --- | |
| name: Second | |
| models: | |
| - model: nbeerbower/Lyra4-Gutenberg-12B | |
| merge_method: nearswap | |
| base_model: Delta-Vector/Rei-V3-KTO-12B | |
| parameters: | |
| t: 0.0008 | |
| dtype: float32 | |
| --- | |
| models: | |
| - model: First | |
| - model: Second | |
| merge_method: karcher | |
| chat_template: auto | |
| dtype: float32 | |
| out_dtype: bfloat16 | |
| parameters: | |
| tol: 1e-9 | |
| max_iter: 1000 | |
| tokenizer: | |
| source: union | |
| </pre> | |
| </details> | |
| </section> | |
| <section class="panel"> | |
| <h2 class="panel-heading">Intended Use</h2> | |
| <div class="columns"> | |
| <div class="item"> | |
| <span class="item-title">Roleplay</span> | |
| <span class="item-note">Character-driven interaction</span> | |
| </div> | |
| <div class="item"> | |
| <span class="item-title">Storytelling</span> | |
| <span class="item-note">Long-form narrative</span> | |
| </div> | |
| <div class="item"> | |
| <span class="item-title">Creative Writing</span> | |
| <span class="item-note">Atmospheric fiction</span> | |
| </div> | |
| </div> | |
| </section> | |
| <div class="line"></div> | |
| </section> | |
| <style> | |
| .wrapper { | |
| --paper: #f6efd9; | |
| --paper-light: #fffaf0; | |
| --paper-deep: #e8dcc2; | |
| --ink: #172136; | |
| --ink-soft: #4d5770; | |
| --night: #1f2d48; | |
| --forest: #2f5d46; | |
| --moss: #68845c; | |
| --oxblood: #843b38; | |
| --gold: #c59a45; | |
| --shadow: rgba(23, 33, 54, 0.2); | |
| --edge: rgba(31, 45, 72, 0.42); | |
| --rule: linear-gradient(90deg, var(--night), var(--gold), var(--forest)); | |
| --cut: 24px; | |
| --cut-small: 15px; | |
| max-width: 1080px; | |
| margin: 58px auto; | |
| padding: 52px; | |
| position: relative; | |
| overflow: hidden; | |
| color: var(--ink); | |
| font-family: "Merriweather", "Iowan Old Style", "Book Antiqua", Georgia, serif; | |
| display: flex; | |
| flex-direction: column; | |
| gap: 38px; | |
| border: 2px solid var(--edge); | |
| background: | |
| radial-gradient(circle at 12% 18%, rgba(132, 59, 56, 0.14), transparent 34%), | |
| radial-gradient(circle at 86% 20%, rgba(47, 93, 70, 0.14), transparent 32%), | |
| radial-gradient(circle at 78% 88%, rgba(197, 154, 69, 0.18), transparent 38%), | |
| linear-gradient(135deg, #fff8e8 0%, #f1e6ca 48%, #e7d9bb 100%); | |
| box-shadow: | |
| 0 28px 70px var(--shadow), | |
| inset 0 0 0 1px rgba(255, 250, 240, 0.8); | |
| clip-path: polygon( | |
| var(--cut) 0, | |
| calc(100% - var(--cut)) 0, | |
| 100% var(--cut), | |
| 100% calc(100% - var(--cut)), | |
| calc(100% - var(--cut)) 100%, | |
| var(--cut) 100%, | |
| 0 calc(100% - var(--cut)), | |
| 0 var(--cut) | |
| ); | |
| } | |
| .wrapper::before { | |
| content: ""; | |
| position: absolute; | |
| inset: 16px; | |
| z-index: 1; | |
| pointer-events: none; | |
| border: 1px solid rgba(132, 59, 56, 0.24); | |
| clip-path: polygon( | |
| var(--cut) 0, | |
| calc(100% - var(--cut)) 0, | |
| 100% var(--cut), | |
| 100% calc(100% - var(--cut)), | |
| calc(100% - var(--cut)) 100%, | |
| var(--cut) 100%, | |
| 0 calc(100% - var(--cut)), | |
| 0 var(--cut) | |
| ); | |
| } | |
| .wrapper::after { | |
| content: ""; | |
| position: absolute; | |
| inset: 0; | |
| z-index: 0; | |
| pointer-events: none; | |
| opacity: 0.32; | |
| background: | |
| repeating-linear-gradient( | |
| 0deg, | |
| rgba(31, 45, 72, 0.035) 0, | |
| rgba(31, 45, 72, 0.035) 1px, | |
| transparent 1px, | |
| transparent 7px | |
| ), | |
| repeating-linear-gradient( | |
| 90deg, | |
| rgba(132, 59, 56, 0.028) 0, | |
| rgba(132, 59, 56, 0.028) 1px, | |
| transparent 1px, | |
| transparent 9px | |
| ), | |
| radial-gradient(circle, rgba(31, 45, 72, 0.18) 1px, transparent 1px); | |
| background-size: auto, auto, 72px 72px; | |
| mix-blend-mode: multiply; | |
| } | |
| .top { | |
| position: relative; | |
| z-index: 2; | |
| text-align: center; | |
| padding: 32px 24px 28px; | |
| border: 1px solid rgba(31, 45, 72, 0.32); | |
| background: | |
| linear-gradient(180deg, rgba(255, 250, 240, 0.94), rgba(232, 220, 194, 0.9)), | |
| repeating-linear-gradient( | |
| 90deg, | |
| rgba(197, 154, 69, 0.09) 0, | |
| rgba(197, 154, 69, 0.09) 1px, | |
| transparent 1px, | |
| transparent 18px | |
| ); | |
| box-shadow: | |
| 0 12px 30px rgba(23, 33, 54, 0.12), | |
| inset 0 0 0 1px rgba(255, 250, 240, 0.72); | |
| clip-path: polygon( | |
| var(--cut) 0, | |
| calc(100% - var(--cut)) 0, | |
| 100% var(--cut), | |
| 100% calc(100% - var(--cut)), | |
| calc(100% - var(--cut)) 100%, | |
| var(--cut) 100%, | |
| 0 calc(100% - var(--cut)), | |
| 0 var(--cut) | |
| ); | |
| } | |
| .heading { | |
| margin: 0; | |
| font-size: clamp(1.2rem, 3vw, 2.05rem); | |
| line-height: 1.08; | |
| letter-spacing: 0.08em; | |
| text-transform: uppercase; | |
| font-weight: 900; | |
| color: var(--night); | |
| text-shadow: | |
| 0 1px 0 rgba(255, 250, 240, 0.95), | |
| 0 0 16px rgba(197, 154, 69, 0.22); | |
| } | |
| .media { | |
| position: relative; | |
| z-index: 2; | |
| display: flex; | |
| justify-content: center; | |
| padding: 4px 0 12px; | |
| } | |
| .media img { | |
| width: 100%; | |
| max-width: 860px; | |
| display: block; | |
| border: 2px solid rgba(197, 154, 69, 0.46); | |
| background: var(--paper-light); | |
| box-shadow: | |
| 0 18px 40px rgba(23, 33, 54, 0.18), | |
| 0 0 0 8px rgba(255, 250, 240, 0.56); | |
| clip-path: polygon( | |
| var(--cut) 0, | |
| calc(100% - var(--cut)) 0, | |
| 100% var(--cut), | |
| 100% calc(100% - var(--cut)), | |
| calc(100% - var(--cut)) 100%, | |
| var(--cut) 100%, | |
| 0 calc(100% - var(--cut)), | |
| 0 var(--cut) | |
| ); | |
| } | |
| .line { | |
| position: relative; | |
| z-index: 2; | |
| height: 4px; | |
| width: 100%; | |
| background: var(--rule); | |
| box-shadow: | |
| 0 0 14px rgba(197, 154, 69, 0.22), | |
| 0 1px 0 rgba(255, 250, 240, 0.9); | |
| clip-path: polygon( | |
| var(--cut-small) 0, | |
| calc(100% - var(--cut-small)) 0, | |
| 100% 50%, | |
| calc(100% - var(--cut-small)) 100%, | |
| var(--cut-small) 100%, | |
| 0 50% | |
| ); | |
| } | |
| .panel { | |
| position: relative; | |
| z-index: 2; | |
| padding: 38px 42px; | |
| border: 1px solid rgba(47, 93, 70, 0.34); | |
| background: | |
| radial-gradient(circle at 12% 10%, rgba(197, 154, 69, 0.11), transparent 32%), | |
| linear-gradient(180deg, rgba(255, 250, 240, 0.96), rgba(239, 229, 205, 0.94)); | |
| box-shadow: | |
| 0 15px 36px rgba(23, 33, 54, 0.13), | |
| inset 0 0 0 1px rgba(255, 250, 240, 0.78); | |
| clip-path: polygon( | |
| var(--cut) 0, | |
| calc(100% - var(--cut)) 0, | |
| 100% var(--cut), | |
| 100% calc(100% - var(--cut)), | |
| calc(100% - var(--cut)) 100%, | |
| var(--cut) 100%, | |
| 0 calc(100% - var(--cut)), | |
| 0 var(--cut) | |
| ); | |
| } | |
| .panel-heading { | |
| margin: 0 0 22px; | |
| font-size: 1.35rem; | |
| letter-spacing: 0.12em; | |
| text-transform: uppercase; | |
| color: var(--forest); | |
| font-weight: 900; | |
| } | |
| .panel p { | |
| margin: 14px 0 26px; | |
| color: var(--ink-soft); | |
| font-family: "Source Serif 4", Georgia, serif; | |
| font-size: 1.04rem; | |
| line-height: 1.85; | |
| } | |
| .accent { | |
| color: var(--oxblood); | |
| font-weight: 900; | |
| } | |
| .text-link { | |
| color: var(--night); | |
| font-weight: 800; | |
| text-decoration: underline; | |
| text-decoration-color: rgba(197, 154, 69, 0.8); | |
| text-decoration-thickness: 1px; | |
| text-underline-offset: 4px; | |
| transition: | |
| color 0.22s ease, | |
| text-decoration-color 0.22s ease; | |
| } | |
| .text-link:hover { | |
| color: var(--oxblood); | |
| text-decoration-color: var(--forest); | |
| } | |
| .toggle { | |
| margin-top: 28px; | |
| overflow: hidden; | |
| border: 1px solid rgba(31, 45, 72, 0.3); | |
| background: var(--paper-light); | |
| box-shadow: | |
| inset 0 0 0 1px rgba(255, 250, 240, 0.72), | |
| 0 10px 24px rgba(23, 33, 54, 0.1); | |
| clip-path: polygon( | |
| var(--cut-small) 0, | |
| calc(100% - var(--cut-small)) 0, | |
| 100% var(--cut-small), | |
| 100% calc(100% - var(--cut-small)), | |
| calc(100% - var(--cut-small)) 100%, | |
| var(--cut-small) 100%, | |
| 0 calc(100% - var(--cut-small)), | |
| 0 var(--cut-small) | |
| ); | |
| } | |
| .toggle summary { | |
| padding: 17px 24px; | |
| cursor: pointer; | |
| color: var(--paper-light); | |
| background: | |
| linear-gradient(90deg, var(--night), #2c3f62, var(--forest)); | |
| font-size: 0.92rem; | |
| font-weight: 900; | |
| letter-spacing: 0.09em; | |
| text-transform: uppercase; | |
| } | |
| .toggle pre { | |
| margin: 0; | |
| padding: 26px 28px; | |
| overflow-x: auto; | |
| color: #25304a; | |
| background: | |
| repeating-linear-gradient( | |
| 0deg, | |
| rgba(31, 45, 72, 0.035) 0, | |
| rgba(31, 45, 72, 0.035) 1px, | |
| transparent 1px, | |
| transparent 8px | |
| ), | |
| linear-gradient(180deg, #fffaf0, #eee1c4); | |
| font-family: "IBM Plex Mono", "SFMono-Regular", Consolas, monospace; | |
| font-size: 0.84rem; | |
| line-height: 1.68; | |
| border-top: 1px solid rgba(31, 45, 72, 0.16); | |
| } | |
| .columns { | |
| display: flex; | |
| gap: 22px; | |
| flex-wrap: wrap; | |
| margin-top: 16px; | |
| } | |
| .item { | |
| flex: 1 1 210px; | |
| padding: 26px 22px; | |
| text-align: center; | |
| border: 1px solid rgba(132, 59, 56, 0.28); | |
| background: | |
| radial-gradient(circle at 50% 0%, rgba(197, 154, 69, 0.12), transparent 44%), | |
| linear-gradient(180deg, rgba(255, 250, 240, 0.98), rgba(235, 224, 200, 0.94)); | |
| box-shadow: | |
| 0 11px 26px rgba(23, 33, 54, 0.1), | |
| inset 0 0 0 1px rgba(255, 250, 240, 0.72); | |
| transition: | |
| transform 0.22s ease, | |
| border-color 0.22s ease, | |
| box-shadow 0.22s ease; | |
| clip-path: polygon( | |
| var(--cut-small) 0, | |
| calc(100% - var(--cut-small)) 0, | |
| 100% var(--cut-small), | |
| 100% calc(100% - var(--cut-small)), | |
| calc(100% - var(--cut-small)) 100%, | |
| var(--cut-small) 100%, | |
| 0 calc(100% - var(--cut-small)), | |
| 0 var(--cut-small) | |
| ); | |
| } | |
| .item:hover { | |
| transform: translateY(-4px); | |
| border-color: rgba(197, 154, 69, 0.6); | |
| box-shadow: | |
| 0 17px 34px rgba(23, 33, 54, 0.16), | |
| 0 0 24px rgba(197, 154, 69, 0.13); | |
| } | |
| .item-title { | |
| display: block; | |
| margin-bottom: 10px; | |
| color: var(--oxblood); | |
| font-size: 1.03rem; | |
| font-weight: 900; | |
| letter-spacing: 0.08em; | |
| text-transform: uppercase; | |
| } | |
| .item-note { | |
| display: block; | |
| color: var(--ink-soft); | |
| font-family: "Source Sans 3", "Segoe UI", sans-serif; | |
| font-size: 0.96rem; | |
| line-height: 1.5; | |
| } | |
| @media (max-width: 650px) { | |
| .wrapper { | |
| margin: 28px 12px; | |
| padding: 30px 22px; | |
| gap: 30px; | |
| --cut: 16px; | |
| --cut-small: 12px; | |
| } | |
| .top { | |
| padding: 28px 16px 24px; | |
| } | |
| .panel { | |
| padding: 30px 24px; | |
| } | |
| .columns { | |
| gap: 16px; | |
| } | |
| .item { | |
| flex: 1 1 100%; | |
| } | |
| } | |
| </style> |