Instructions to use coldstone7/qwen3.6-27b_llresearch with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use coldstone7/qwen3.6-27b_llresearch with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M # Run inference directly in the terminal: llama cli -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M # Run inference directly in the terminal: llama cli -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Use Docker
docker model run hf.co/coldstone7/qwen3.6-27b_llresearch:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use coldstone7/qwen3.6-27b_llresearch with Ollama:
ollama run hf.co/coldstone7/qwen3.6-27b_llresearch:Q4_K_M
- Unsloth Desktop
- Pi
How to use coldstone7/qwen3.6-27b_llresearch with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "coldstone7/qwen3.6-27b_llresearch:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use coldstone7/qwen3.6-27b_llresearch with Docker Model Runner:
docker model run hf.co/coldstone7/qwen3.6-27b_llresearch:Q4_K_M
- Lemonade
How to use coldstone7/qwen3.6-27b_llresearch with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Run and chat with the model
lemonade run user.qwen3.6-27b_llresearch-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use coldstone7/qwen3.6-27b_llresearch with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use coldstone7/qwen3.6-27b_llresearch with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf coldstone7/qwen3.6-27b_llresearch:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "coldstone7/qwen3.6-27b_llresearch:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
qwen3.6-27b_llresearch : GGUF
This model was finetuned and converted to GGUF format using Unsloth.
Example usage:
- For text only LLMs:
llama-cli -hf coldstone7/qwen3.6-27b_llresearch --jinja - For multimodal models:
llama-mtmd-cli -hf coldstone7/qwen3.6-27b_llresearch --jinja
Available Model files:
Qwen3.6-27B.Q8_0.ggufQwen3.6-27B.Q6_K.ggufQwen3.6-27B.Q4_K_M.ggufQwen3.6-27B.BF16-mmproj.gguf
This was trained 2x faster with Unsloth

Benchmark: fine-tuned vs base Qwen/Qwen3.6-27B
Methodology
- Base model:
Qwen/Qwen3.6-27B(confirmed via this checkpoint's ownconfig.json->model_name). - Fine-tuned model: this repo (
coldstone7/qwen3.6-27b_llresearch), Unsloth QLoRA fine-tune, GGUF export. - Reasoning benchmarks are SAMPLES, not full official suites (GSM8K n=100, MMLU-Pro n=180, ARC-Challenge n=100 โ stratified random samples, exact-match scoring, no judge model involved).
- Coaching-quality eval uses a blind, randomized A/B judge (
qwen/qwen3.6-35b-a3b, the largest unrelated-architecture model available for this run; still Qwen3.6-family, so family bias is reduced but not fully eliminated โ treat quality deltas as directional, not definitive). - Hardware: single RTX PRO 6000 Blackwell (96GB), models served sequentially (not concurrently).
Scorecard
| Metric | Base | Fine-tuned | Delta |
|---|---|---|---|
| GSM8K accuracy (n=100 sample) | 0.740 | 0.717 | -3.1% |
| MMLU-Pro accuracy (n=180 sample) | 0.570 | 0.670 | +17.7% |
| ARC-Challenge accuracy (n=100 sample) | 0.870 | 0.910 | +4.6% |
| Coaching quality โ coaching_signal (1-5) | 4.25 | 4.40 | +3.5% |
| Coaching quality โ depth_progression (1-5) | 4.00 | 3.90 | -2.5% |
| Coaching quality โ domain_accuracy (1-5) | 1.75 | 1.80 | +2.9% |
| Coaching quality โ kai_voice (1-5) | 4.10 | 4.00 | -2.4% |
| Coaching quality โ socratic_quality (1-5) | 4.15 | 4.15 | 0.0% |
| Coaching quality โ turn_coherence (1-5) | 4.60 | 4.65 | +1.1% |
| Blind judge win-rate (of 20 prompts) | 11 | 8 | (1 tie) |
| Decode tok/s @ 1K input | 51.2 | 61.9 | โ |
Takeaways:
- No catastrophic forgetting from fine-tuning โ general reasoning held steady or improved. MMLU-Pro improved notably (+17.7%).
- Coaching-quality is close to a wash on this sample: base actually edges out the blind win-rate (11 vs 8, 1 tie), with both models scoring nearly identically across style dimensions. The fine-tune's edge shows up more in reasoning benchmarks than in coaching-voice quality here.
- Fine-tuned decodes ~21% faster, mostly a quantization effect (Q4_K_M vs base's Q6_K in this comparison).
Qualitative example
Prompt: A client asks you to explain, in your own coaching voice, what this means for them and how they might work with it: "genekey --number 51". Ground your explanation accurately in the framework.
Base: "...Gene Key 51 is a deeply electric piece of your energetic blueprint... When this energy moves unconsciously, it often shows up as The Shocker... as you bring awareness to it, the energy softens into The Awakener..."
Fine-tuned: "...Gene Key 51 is often called the Key of Arousal... In its shadow, this key tends to show up as fear, panic, or a reflexive bracing against change... The activation of this key gently asks us to stop running from the shock and instead learn to be present with it..."
(Judge scored both 4-5/5 across dimensions on this example โ full raw prompts/responses/scores for all 20 coaching prompts and all 380 reasoning questions per model available on request.)
Caveats
- Reasoning benchmark sample sizes are small relative to full official suites โ treat as directional, not authoritative.
- LLM-judge scoring has inherent noise/variance even with a neutral judge and blind ordering.
- Sequential serving means these results were not collected in a single controlled run โ server warm-up/thermal state may differ slightly between models.
- Downloads last month
- 26
4-bit
6-bit
8-bit