Instructions to use FoolDev/Janus-35B-HERETIC with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FoolDev/Janus-35B-HERETIC with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="FoolDev/Janus-35B-HERETIC") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("FoolDev/Janus-35B-HERETIC", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use FoolDev/Janus-35B-HERETIC with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: llama cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: llama cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf FoolDev/Janus-35B-HERETIC:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Use Docker
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use FoolDev/Janus-35B-HERETIC with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FoolDev/Janus-35B-HERETIC" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- SGLang
How to use FoolDev/Janus-35B-HERETIC with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FoolDev/Janus-35B-HERETIC" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FoolDev/Janus-35B-HERETIC" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FoolDev/Janus-35B-HERETIC", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Ollama
How to use FoolDev/Janus-35B-HERETIC with Ollama:
ollama run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- Unsloth Studio
How to use FoolDev/Janus-35B-HERETIC with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for FoolDev/Janus-35B-HERETIC to start chatting
- Pi
How to use FoolDev/Janus-35B-HERETIC with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "FoolDev/Janus-35B-HERETIC:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use FoolDev/Janus-35B-HERETIC with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default FoolDev/Janus-35B-HERETIC:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use FoolDev/Janus-35B-HERETIC with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf FoolDev/Janus-35B-HERETIC:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "FoolDev/Janus-35B-HERETIC:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use FoolDev/Janus-35B-HERETIC with Docker Model Runner:
docker model run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M
- Lemonade
How to use FoolDev/Janus-35B-HERETIC with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull FoolDev/Janus-35B-HERETIC:Q4_K_M
Run and chat with the model
lemonade run user.Janus-35B-HERETIC-Q4_K_M
List all available models
lemonade list
Rename HF slug FoolDev/Janus-35B -> FoolDev/Janus-35B-HERETIC
Browse filesThe HF repo was renamed to the -HERETIC canonical (old slug now 307-redirects).
Repoint every live self-reference to the new slug: README banner/bmc-banner/
moe-routing resolve URLs, ollama run pull one-liners (TL;DR + Quick start),
git clone + cd, the bridge-files table row, and CITATION.cff url/repository-code.
Also repoint the dense-sibling cross-links (Related-models row + CITATION
references) to FoolDev/Thanatos-27B-HERETIC, and set origin to
git@hf.co:FoolDev/Janus-35B-HERETIC.
Display name stays 'Janus-35B'; past-tense CHANGELOG history preserved verbatim.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
- CHANGELOG.md +16 -0
- CITATION.cff +3 -3
- README.md +10 -10
|
@@ -8,6 +8,22 @@ track the **tooling and documentation**, not the underlying base model.
|
|
| 8 |
|
| 9 |
## [Unreleased]
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
### Added
|
| 12 |
- **`scripts/build.sh`** β self-contained builder that pulls a GGUF from
|
| 13 |
[`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF)
|
|
|
|
| 8 |
|
| 9 |
## [Unreleased]
|
| 10 |
|
| 11 |
+
### Changed (HF repo rename β FoolDev/Janus-35B-HERETIC)
|
| 12 |
+
- **HF repository slug renamed `FoolDev/Janus-35B` β `FoolDev/Janus-35B-HERETIC`.**
|
| 13 |
+
The old slug now 307-redirects to the new one. The model's **display name
|
| 14 |
+
stays `Janus-35B`** β only the repo path / URLs change. Repointed every
|
| 15 |
+
live self-reference to the new slug: the README banner / `bmc-banner` /
|
| 16 |
+
`moe-routing` `resolve/main/...` image URLs, the `ollama run hf.co/...`
|
| 17 |
+
pull one-liners (TL;DR + Ollama Quick start), the `git clone` +
|
| 18 |
+
`cd` line, the bridge-files table row, and `CITATION.cff`'s
|
| 19 |
+
`repository-code` / `url`. `scripts/build.sh` defaults (`REPO_ID`
|
| 20 |
+
upstream `llmfan46/...`, local `janus` Ollama tag) don't reference the
|
| 21 |
+
FoolDev slug, so they were left as-is. Also repointed the dense-sibling
|
| 22 |
+
cross-links (README "Related models" row + `CITATION.cff` references entry)
|
| 23 |
+
to `FoolDev/Thanatos-27B-HERETIC`, and set the git remote to
|
| 24 |
+
`git@hf.co:FoolDev/Janus-35B-HERETIC`. Past-tense CHANGELOG history
|
| 25 |
+
(redirect notes, the earlier lowercase-`janus` fix) is preserved verbatim.
|
| 26 |
+
|
| 27 |
### Added
|
| 28 |
- **`scripts/build.sh`** β self-contained builder that pulls a GGUF from
|
| 29 |
[`llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF`](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF)
|
|
@@ -5,8 +5,8 @@ type: software
|
|
| 5 |
authors:
|
| 6 |
- name: FoolDev
|
| 7 |
website: "https://huggingface.co/FoolDev"
|
| 8 |
-
repository-code: "https://huggingface.co/FoolDev/Janus-35B"
|
| 9 |
-
url: "https://huggingface.co/FoolDev/Janus-35B"
|
| 10 |
abstract: >-
|
| 11 |
Janus-35B is a personal repackaging of llmfan46's uncensored Heretic
|
| 12 |
abliteration of the Qwen 3.6 35B-A3B mixture-of-experts base (35B
|
|
@@ -43,4 +43,4 @@ references:
|
|
| 43 |
title: "Thanatos-27B (dense sibling)"
|
| 44 |
authors:
|
| 45 |
- name: FoolDev
|
| 46 |
-
url: "https://huggingface.co/FoolDev/Thanatos-27B"
|
|
|
|
| 5 |
authors:
|
| 6 |
- name: FoolDev
|
| 7 |
website: "https://huggingface.co/FoolDev"
|
| 8 |
+
repository-code: "https://huggingface.co/FoolDev/Janus-35B-HERETIC"
|
| 9 |
+
url: "https://huggingface.co/FoolDev/Janus-35B-HERETIC"
|
| 10 |
abstract: >-
|
| 11 |
Janus-35B is a personal repackaging of llmfan46's uncensored Heretic
|
| 12 |
abliteration of the Qwen 3.6 35B-A3B mixture-of-experts base (35B
|
|
|
|
| 43 |
title: "Thanatos-27B (dense sibling)"
|
| 44 |
authors:
|
| 45 |
- name: FoolDev
|
| 46 |
+
url: "https://huggingface.co/FoolDev/Thanatos-27B-HERETIC"
|
|
@@ -46,14 +46,14 @@ library_name: transformers
|
|
| 46 |
pipeline_tag: image-text-to-text
|
| 47 |
---
|
| 48 |
|
| 49 |
-
<img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
|
| 50 |
|
| 51 |
[](https://opensource.org/licenses/Apache-2.0)
|
| 52 |
[](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
|
| 53 |
[](#architecture)
|
| 54 |
[](#whats-here)
|
| 55 |
|
| 56 |
-
<a href="https://buymeacoffee.com/cardoffoolm"><img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/bmc-banner.svg" alt="Buy me a coffee β support Janus-35B" width="320" /></a>
|
| 57 |
|
| 58 |
# Janus-35B
|
| 59 |
|
|
@@ -72,15 +72,15 @@ template β HF's Ollama bridge ingests those three files, not
|
|
| 72 |
`Modelfile`):
|
| 73 |
|
| 74 |
```bash
|
| 75 |
-
ollama run hf.co/FoolDev/Janus-35B # default ~19 GB Q4_K_M
|
| 76 |
-
ollama run hf.co/FoolDev/Janus-35B:Q4_K_M # same blob, explicit tag
|
| 77 |
```
|
| 78 |
|
| 79 |
Or build locally (uses this repo's `Modelfile`, kept in sync with the
|
| 80 |
three bridge files):
|
| 81 |
|
| 82 |
```bash
|
| 83 |
-
git clone https://huggingface.co/FoolDev/Janus-35B && cd Janus-35B
|
| 84 |
ollama create janus -f Modelfile && ollama run janus
|
| 85 |
```
|
| 86 |
|
|
@@ -95,7 +95,7 @@ and `thinking` under Capabilities. Hardware: ~38 GB RAM at default
|
|
| 95 |
|---|---|
|
| 96 |
| `Janus-35B-A3B.Q4_K_M.gguf` | Recommended default, ~19 GB |
|
| 97 |
| `Modelfile` | Ollama wrapper for **local** builds (`ollama create janus -f Modelfile`) β overrides the GGUF's embedded template with one that exposes `.Tools` / `.ToolCalls` to Ollama's capability detector. |
|
| 98 |
-
| `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
|
| 99 |
| `scripts/build.sh` | Pulls a GGUF from `llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF` (default Q4_K_M) and runs `ollama create janus`. The bundled Q4_K_M is already this Heretic quant; use this to build other quants locally. |
|
| 100 |
| `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
|
| 101 |
|
|
@@ -111,7 +111,7 @@ GGUF-only release. Pull the Heretic safetensors from [`llmfan46/Qwen3.6-35B-A3B-
|
|
| 111 |
## Architecture
|
| 112 |
|
| 113 |
<p align="left">
|
| 114 |
-
<img src="https://huggingface.co/FoolDev/Janus-35B/resolve/main/moe-routing.svg" alt="animated MoE routing visualization: 16x16 grid of 256 expert dots with 8 lit at any time, cycling through 8 routing patterns" width="640" />
|
| 115 |
</p>
|
| 116 |
|
| 117 |
- Qwen 3.6, 35B total / 3B active, MoE (256 experts, 8 activated per token)
|
|
@@ -132,8 +132,8 @@ The chat template baked into the GGUF is **not sufficient on Ollama** β it lac
|
|
| 132 |
|
| 133 |
```bash
|
| 134 |
# A. Pull straight from HF (uses the root-level template/system/params files):
|
| 135 |
-
ollama run hf.co/FoolDev/Janus-35B # default tag, ~19 GB Q4_K_M
|
| 136 |
-
ollama run hf.co/FoolDev/Janus-35B:Q4_K_M # same blob, explicit tag
|
| 137 |
# Note: HF's Ollama bridge does NOT read Modelfile; it reads template/system/params.
|
| 138 |
|
| 139 |
# B. Build locally (uses Modelfile, which is kept in sync with the three above):
|
|
@@ -338,7 +338,7 @@ print(resp.choices[0].message.tool_calls)
|
|
| 338 |
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs β pull one here for the uncensored behavior until the bundled blob is rebundled. |
|
| 339 |
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
|
| 340 |
| [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
|
| 341 |
-
| [FoolDev/Thanatos-27B](https://huggingface.co/FoolDev/Thanatos-27B) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The
|
| 342 |
| [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune on a smaller 9B Qwen base. Useful as a fast first-pass model when 35B is too heavy for the host. |
|
| 343 |
|
| 344 |
## Credits
|
|
|
|
| 46 |
pipeline_tag: image-text-to-text
|
| 47 |
---
|
| 48 |
|
| 49 |
+
<img src="https://huggingface.co/FoolDev/Janus-35B-HERETIC/resolve/main/banner.svg" alt="Janus-35B banner" width="100%" />
|
| 50 |
|
| 51 |
[](https://opensource.org/licenses/Apache-2.0)
|
| 52 |
[](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic)
|
| 53 |
[](#architecture)
|
| 54 |
[](#whats-here)
|
| 55 |
|
| 56 |
+
<a href="https://buymeacoffee.com/cardoffoolm"><img src="https://huggingface.co/FoolDev/Janus-35B-HERETIC/resolve/main/bmc-banner.svg" alt="Buy me a coffee β support Janus-35B" width="320" /></a>
|
| 57 |
|
| 58 |
# Janus-35B
|
| 59 |
|
|
|
|
| 72 |
`Modelfile`):
|
| 73 |
|
| 74 |
```bash
|
| 75 |
+
ollama run hf.co/FoolDev/Janus-35B-HERETIC # default ~19 GB Q4_K_M
|
| 76 |
+
ollama run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M # same blob, explicit tag
|
| 77 |
```
|
| 78 |
|
| 79 |
Or build locally (uses this repo's `Modelfile`, kept in sync with the
|
| 80 |
three bridge files):
|
| 81 |
|
| 82 |
```bash
|
| 83 |
+
git clone https://huggingface.co/FoolDev/Janus-35B-HERETIC && cd Janus-35B-HERETIC
|
| 84 |
ollama create janus -f Modelfile && ollama run janus
|
| 85 |
```
|
| 86 |
|
|
|
|
| 95 |
|---|---|
|
| 96 |
| `Janus-35B-A3B.Q4_K_M.gguf` | Recommended default, ~19 GB |
|
| 97 |
| `Modelfile` | Ollama wrapper for **local** builds (`ollama create janus -f Modelfile`) β overrides the GGUF's embedded template with one that exposes `.Tools` / `.ToolCalls` to Ollama's capability detector. |
|
| 98 |
+
| `template`, `system`, `params` | Used by HF's Ollama bridge when users `ollama run hf.co/FoolDev/Janus-35B-HERETIC` directly. The bridge does **not** read `Modelfile` (see [HF Ollama docs](https://huggingface.co/docs/hub/en/ollama)); it ingests these three root-level files instead. Kept in sync with the `Modelfile`'s `TEMPLATE` / `SYSTEM` / `PARAMETER` directives. |
|
| 99 |
| `scripts/build.sh` | Pulls a GGUF from `llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF` (default Q4_K_M) and runs `ollama create janus`. The bundled Q4_K_M is already this Heretic quant; use this to build other quants locally. |
|
| 100 |
| `scripts/check_bridge_sync.py` | Run before pushing a `Modelfile` / `template` / `system` / `params` edit to verify the four configurations remain in sync. Exits 0 if in sync, 1 with a per-key diff if not. |
|
| 101 |
|
|
|
|
| 111 |
## Architecture
|
| 112 |
|
| 113 |
<p align="left">
|
| 114 |
+
<img src="https://huggingface.co/FoolDev/Janus-35B-HERETIC/resolve/main/moe-routing.svg" alt="animated MoE routing visualization: 16x16 grid of 256 expert dots with 8 lit at any time, cycling through 8 routing patterns" width="640" />
|
| 115 |
</p>
|
| 116 |
|
| 117 |
- Qwen 3.6, 35B total / 3B active, MoE (256 experts, 8 activated per token)
|
|
|
|
| 132 |
|
| 133 |
```bash
|
| 134 |
# A. Pull straight from HF (uses the root-level template/system/params files):
|
| 135 |
+
ollama run hf.co/FoolDev/Janus-35B-HERETIC # default tag, ~19 GB Q4_K_M
|
| 136 |
+
ollama run hf.co/FoolDev/Janus-35B-HERETIC:Q4_K_M # same blob, explicit tag
|
| 137 |
# Note: HF's Ollama bridge does NOT read Modelfile; it reads template/system/params.
|
| 138 |
|
| 139 |
# B. Build locally (uses Modelfile, which is kept in sync with the three above):
|
|
|
|
| 338 |
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-GGUF) | 35B / 3B active | Heretic GGUFs β pull one here for the uncensored behavior until the bundled blob is rebundled. |
|
| 339 |
| [llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved](https://huggingface.co/llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved) | 35B / 3B active | Same Heretic base but keeps the MTP head for vLLM / SGLang speculative decoding. |
|
| 340 |
| [Qwen/Qwen3.6-35B-A3B](https://huggingface.co/Qwen/Qwen3.6-35B-A3B) | 35B / 3B active | Upstream pre-Heretic base model. `transformers`-native multimodal weights. |
|
| 341 |
+
| [FoolDev/Thanatos-27B-HERETIC](https://huggingface.co/FoolDev/Thanatos-27B-HERETIC) | 27B dense | Dense sibling on the [`llmfan46/Qwen3.6-27B-uncensored-heretic-v2`](https://huggingface.co/llmfan46/Qwen3.6-27B-uncensored-heretic-v2) Heretic base. Same teacher (Fable 5), same dataset family, smaller memory footprint, no MoE quirks. (The older `FoolDev/Thanatos-27B` and `Thanatos-27B-Heretic` slugs now 307 to this path.) |
|
| 342 |
| [Crownelius/Crow-9B-HERETIC-4.6](https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6) | 9B dense | Heretic-flavored fine-tune on a smaller 9B Qwen base. Useful as a fast first-pass model when 35B is too heavy for the host. |
|
| 343 |
|
| 344 |
## Credits
|