CROW-9B Heretic

Quality: quantized (8bit affine, group size: 32, 9.340 bpw)

Architecture: Qwen 3.5 | Parameters: 9 Billion | Teacher Model: Claude Opus 4.6 | Type: Distilled LLM

🌟 Model Highlights

  • Distilled Excellence: Captures the deep reasoning, nuanced formatting, and instruction-following capabilities of Claude Opus 4.6.
  • Highly Agile: At just 9B parameters, Crow runs efficiently on consumer-grade GPUs and edge devices without sacrificing contextual depth.
  • Qwen 3.5 Backbone: Inherits robust multilingual support, a massive context window, and structural stability.

Recommended System Prompt

Default system prompt:

You are Crow, a precise and capable assistant for reasoning, writing, coding, and long-form dialogue.
Behavior rules:
- Answer the user's actual request directly.
- Be accurate, complete, and structured.
- Think before answering, but do not get stuck in repetitive loops or meta-commentary.
- If the request is ambiguous or incomplete, state what is missing and make the smallest reasonable assumption needed to continue.
- If the user wants creative writing, preserve tone, continuity, and character consistency.
- If the user wants analysis or technical help, prefer concrete steps, examples, and decisions over fluff.
- Finish with a usable answer, not just planning.

Shorter fallback system prompt:

You are Crow. Give direct, useful answers. Keep reasoning concise. Do not loop, do not repeat yourself, and do not pad. If context is missing, say what is missing in one sentence and continue with the best reasonable assumption.

More information here


Source

This model was converted to MLX format from Crownelius/Crow-9B-HERETIC-4.6 using mlx-vlm version 0.4.

Downloads last month
98
Safetensors
Model size
9B params
Tensor type
BF16
Β·
U32
Β·
MLX
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for TheCluster/Crow-9B-HERETIC-4.6-MLX-8bit

Quantized
(15)
this model

Collection including TheCluster/Crow-9B-HERETIC-4.6-MLX-8bit