Instructions to use infosave/cortiq_qwopus_dev with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use infosave/cortiq_qwopus_dev with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="infosave/cortiq_qwopus_dev", filename="qwopus-nvg-12b-F16.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use infosave/cortiq_qwopus_dev with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf infosave/cortiq_qwopus_dev:Q4_K_M # Run inference directly in the terminal: llama cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf infosave/cortiq_qwopus_dev:Q4_K_M # Run inference directly in the terminal: llama cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
Use Docker
docker model run hf.co/infosave/cortiq_qwopus_dev:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use infosave/cortiq_qwopus_dev with Ollama:
ollama run hf.co/infosave/cortiq_qwopus_dev:Q4_K_M
- Unsloth Studio
How to use infosave/cortiq_qwopus_dev with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for infosave/cortiq_qwopus_dev to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for infosave/cortiq_qwopus_dev to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for infosave/cortiq_qwopus_dev to start chatting
- Pi
How to use infosave/cortiq_qwopus_dev with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf infosave/cortiq_qwopus_dev:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "infosave/cortiq_qwopus_dev:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use infosave/cortiq_qwopus_dev with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf infosave/cortiq_qwopus_dev:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default infosave/cortiq_qwopus_dev:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use infosave/cortiq_qwopus_dev with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf infosave/cortiq_qwopus_dev:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "infosave/cortiq_qwopus_dev:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use infosave/cortiq_qwopus_dev with Docker Model Runner:
docker model run hf.co/infosave/cortiq_qwopus_dev:Q4_K_M
- Lemonade
How to use infosave/cortiq_qwopus_dev with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull infosave/cortiq_qwopus_dev:Q4_K_M
Run and chat with the model
lemonade run user.cortiq_qwopus_dev-Q4_K_M
List all available models
lemonade list
| license: mit | |
| language: | |
| - en | |
| base_model: | |
| - Jackrong/Qwopus3.6-27B-v2-MTP-GGUF | |
| --- | |
| license: mit | |
| --- | |
| # Cortiq_qwopus_dev | |
| **Cortiq_qwopus_dev 12B** is a task-specialized coding model compiled from | |
| [Jackrong/Qwopus3.6-27B-v2-MTP-GGUF](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2-MTP-GGUF), | |
| a Multi-Token Prediction (MTP) reasoning model ultimately derived from | |
| [Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B). | |
| The original 27B model is compressed down to an effective ~12B parameters using a | |
| proprietary dynamic neural network compression method developed by | |
| [AllAIGate](https://allaigate.com/). | |
| The compression is performed via the **CORTIQ method** — a system and method | |
| for Dynamic Task-Guided Neural Network Compression with Catastrophic Forgetting | |
| Prevention, covered under **US Patent Application No. 19/452,464** | |
| (filed January 19, 2026). | |
| Unlike naive pruning or pure quantization, CORTIQ preserves task‑critical | |
| knowledge during compression by dynamically guiding the pruning process toward | |
| the target domain (**code generation / agentic coding**), while actively | |
| preventing degradation of the model's core reasoning capabilities. | |
| --- | |
| ## Model Details | |
| | Property | Value | | |
| |---------------------|----------------------------------------------------------------| | |
| | **Repository** | `infosave/cortiq_qwopus_dev` | | |
| | **Format(s)** | Safetensors, GGUF | | |
| | **GGUF filename** | `qwopus-nvg-12b-F16.gguf` | | |
| | **Base model** | [Qwopus3.6-27B-v2-MTP-GGUF](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2-MTP-GGUF) | | |
| | **Base root** | Qwen3.6-27B | | |
| | **Architecture** | `qwen3_5_text` (decoder-only transformer) | | |
| | **Model size** | ~15B stored params (BF16) | | |
| | **Effective size** | ~12B parameters after CORTIQ compression | | |
| | **Tensor type** | BF16 | | |
| | **License** | MIT | | |
| | **Compression** | CORTIQ (Dynamic Task-Guided Compression + CF prevention) | | |
| | **Developer** | [AllAIGate](https://allaigate.com/) | | |
| *Note:* “12B” refers to the effective parameter budget of the compressed | |
| topology; Hugging Face reports ~15B stored BF16 parameters for this checkpoint. | |
| --- | |
| ## Why Qwopus3.6-27B-v2-MTP as Base? | |
| `Qwopus3.6-27B-v2-MTP` is a reasoning‑centric variant of Qwen3.6‑27B with | |
| Multi‑Token Prediction and dedicated alignment for **reasoning, coding, | |
| DevOps, and math**. It already incorporates: | |
| - **MTP speculative decoding** for higher throughput on long sequences | |
| - Training focused on structured reasoning and code / math workflows | |
| - A Qwen3.6‑27B backbone with strong general‑purpose capabilities | |
| Cortiq_qwopus_dev inherits these strengths and then further specializes them | |
| via CORTIQ toward **coding + agentic / tool‑use scenarios**. | |
| --- | |
| ## CORTIQ Compression | |
| CORTIQ is a dynamic, task‑guided compression pipeline designed to retain | |
| reasoning and coding ability under strong parameter reduction: | |
| 1. **Task‑guided pruning** – importance is measured under code‑centric | |
| workloads; pruning focuses on preserving coding and reasoning subspaces. | |
| 2. **Catastrophic forgetting prevention** – regularization and replay prevent | |
| collapse of instruction‑following and general reasoning during compression. | |
| 3. **Layer‑wise adaptation** – pruning ratios differ per layer/head based on | |
| activation statistics instead of a uniform global threshold. | |
| The result is a ~12B‑effective model with significantly lower memory and better | |
| latency compared to the original 27B model, while keeping most of its coding | |
| and reasoning performance. | |
| --- | |
| ## Intended Use | |
| Cortiq_qwopus_dev is designed primarily for **agentic coding workflows**: | |
| - Code generation (functions, classes, modules) from natural‑language specs | |
| - Code completion and in‑editor assistance | |
| - Debugging and error analysis (explain exceptions, suggest fixes) | |
| - DevOps / infra automation (scripts, configs, runbooks) | |
| - Code explanation for education / documentation | |
| - Tool‑use / function calling in coding agents | |
| Target stacks include (but are not limited to): Python, JavaScript/TypeScript, | |
| C/C++, Rust, Go, Java, SQL, Bash, and infrastructure‑as‑code ecosystems. | |
| --- | |
| ## Usage | |
| ### llama.cpp | |
| Instructions below come from the Hugging Face “local apps” integration for | |
| `infosave/cortiq_qwopus_dev` [page:1]. | |
| ```bash | |
| # Install via Homebrew (macOS / Linux) | |
| brew install llama.cpp | |
| # Start a local OpenAI-compatible server with web UI: | |
| llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| # Run inference directly in the terminal: | |
| llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| ``` | |
| Windows (WinGet): | |
| ```bash | |
| winget install llama.cpp | |
| # Server: | |
| llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| # CLI: | |
| llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| ``` | |
| Prebuilt binary (GitHub releases of llama.cpp): | |
| ```bash | |
| ./llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| ./llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M | |
| ``` | |
| ### Python (llama-cpp-python) | |
| Сниппет также берётся напрямую из страницы модели [page:1]: | |
| ```python | |
| # pip install llama-cpp-python | |
| from llama_cpp import Llama | |
| llm = Llama.from_pretrained( | |
| repo_id="infosave/cortiq_qwopus_dev", | |
| filename="qwopus-nvg-12b-F16.gguf", | |
| ) | |
| resp = llm.create_chat_completion( | |
| messages=[ | |
| {"role": "user", "content": "Write a Python quicksort implementation."} | |
| ] | |
| ) | |
| print(resp["choices"]["message"]["content"]) | |
| ``` | |
| ### Ollama | |
| ```bash | |
| ollama run hf.co/infosave/cortiq_qwopus_dev:Q4_K_M | |
| ``` | |
| ### LM Studio / Jan / Unsloth / другие клиенты | |
| Модель уже интегрирована в стандартные “local apps” Hugging Face | |
| (LLM Studio, Jan, Unsloth, Pi, Hermes Agent, Docker Model Runner, Lemonade и др.), | |
| и может быть выбрана поиском по имени `infosave/cortiq_qwopus_dev` [page:1]. | |
| --- | |
| ## Limitations | |
| - Модель специализирована под код и агентные сценарии; для чисто | |
| “общечатовых” задач необязательно будет оптимальна. | |
| - Крайне длинный контекст с множеством файлов и инструкций может ухудшать | |
| качество генерации. | |
| - Не предназначена для формально верифицированной или safety‑critical разработки; | |
| всегда проверяйте вывод перед использованием в проде. | |
| --- | |
| ## License | |
| This model is released under the **MIT License** (as specified on the model | |
| page). [page:1] | |
| The underlying CORTIQ compression method is proprietary and patent‑pending. | |
| Commercial use of the weights follows MIT; separate licensing may be required | |
| for direct use of the CORTIQ pipeline itself. | |
| --- | |
| ## Citation | |
| ```bibtex | |
| @misc{allaigate2026cortiq_qwopus_dev, | |
| title = {Cortiq\_qwopus\_dev 12B: | |
| Task-Specialized Coding via Dynamic Compression | |
| from Qwopus3.6-27B-v2-MTP}, | |
| author = {AllAIGate}, | |
| year = {2026}, | |
| howpublished = {\url{https://huggingface.co/infosave/cortiq_qwopus_dev}}, | |
| note = {Base: Jackrong/Qwopus3.6-27B-v2-MTP-GGUF. | |
| CORTIQ method: US Patent Application No. 19/452,464} | |
| } | |
| ``` |