cortiq_qwopus_dev / README.md
infosave's picture
Update README.md
aecb52c verified
|
Raw
History Blame Contribute Delete
7.81 kB
---
license: mit
language:
- en
base_model:
- Jackrong/Qwopus3.6-27B-v2-MTP-GGUF
---
---
license: mit
---
# Cortiq_qwopus_dev
**Cortiq_qwopus_dev 12B** is a task-specialized coding model compiled from
[Jackrong/Qwopus3.6-27B-v2-MTP-GGUF](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2-MTP-GGUF),
a Multi-Token Prediction (MTP) reasoning model ultimately derived from
[Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B).
The original 27B model is compressed down to an effective ~12B parameters using a
proprietary dynamic neural network compression method developed by
[AllAIGate](https://allaigate.com/).
The compression is performed via the **CORTIQ method** — a system and method
for Dynamic Task-Guided Neural Network Compression with Catastrophic Forgetting
Prevention, covered under **US Patent Application No. 19/452,464**
(filed January 19, 2026).
Unlike naive pruning or pure quantization, CORTIQ preserves task‑critical
knowledge during compression by dynamically guiding the pruning process toward
the target domain (**code generation / agentic coding**), while actively
preventing degradation of the model's core reasoning capabilities.
---
## Model Details
| Property | Value |
|---------------------|----------------------------------------------------------------|
| **Repository** | `infosave/cortiq_qwopus_dev` |
| **Format(s)** | Safetensors, GGUF |
| **GGUF filename** | `qwopus-nvg-12b-F16.gguf` |
| **Base model** | [Qwopus3.6-27B-v2-MTP-GGUF](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2-MTP-GGUF) |
| **Base root** | Qwen3.6-27B |
| **Architecture** | `qwen3_5_text` (decoder-only transformer) |
| **Model size** | ~15B stored params (BF16) |
| **Effective size** | ~12B parameters after CORTIQ compression |
| **Tensor type** | BF16 |
| **License** | MIT |
| **Compression** | CORTIQ (Dynamic Task-Guided Compression + CF prevention) |
| **Developer** | [AllAIGate](https://allaigate.com/) |
*Note:* “12B” refers to the effective parameter budget of the compressed
topology; Hugging Face reports ~15B stored BF16 parameters for this checkpoint.
---
## Why Qwopus3.6-27B-v2-MTP as Base?
`Qwopus3.6-27B-v2-MTP` is a reasoning‑centric variant of Qwen3.6‑27B with
Multi‑Token Prediction and dedicated alignment for **reasoning, coding,
DevOps, and math**. It already incorporates:
- **MTP speculative decoding** for higher throughput on long sequences
- Training focused on structured reasoning and code / math workflows
- A Qwen3.6‑27B backbone with strong general‑purpose capabilities
Cortiq_qwopus_dev inherits these strengths and then further specializes them
via CORTIQ toward **coding + agentic / tool‑use scenarios**.
---
## CORTIQ Compression
CORTIQ is a dynamic, task‑guided compression pipeline designed to retain
reasoning and coding ability under strong parameter reduction:
1. **Task‑guided pruning** – importance is measured under code‑centric
workloads; pruning focuses on preserving coding and reasoning subspaces.
2. **Catastrophic forgetting prevention** – regularization and replay prevent
collapse of instruction‑following and general reasoning during compression.
3. **Layer‑wise adaptation** – pruning ratios differ per layer/head based on
activation statistics instead of a uniform global threshold.
The result is a ~12B‑effective model with significantly lower memory and better
latency compared to the original 27B model, while keeping most of its coding
and reasoning performance.
---
## Intended Use
Cortiq_qwopus_dev is designed primarily for **agentic coding workflows**:
- Code generation (functions, classes, modules) from natural‑language specs
- Code completion and in‑editor assistance
- Debugging and error analysis (explain exceptions, suggest fixes)
- DevOps / infra automation (scripts, configs, runbooks)
- Code explanation for education / documentation
- Tool‑use / function calling in coding agents
Target stacks include (but are not limited to): Python, JavaScript/TypeScript,
C/C++, Rust, Go, Java, SQL, Bash, and infrastructure‑as‑code ecosystems.
---
## Usage
### llama.cpp
Instructions below come from the Hugging Face “local apps” integration for
`infosave/cortiq_qwopus_dev` [page:1].
```bash
# Install via Homebrew (macOS / Linux)
brew install llama.cpp
# Start a local OpenAI-compatible server with web UI:
llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
```
Windows (WinGet):
```bash
winget install llama.cpp
# Server:
llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M
# CLI:
llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
```
Prebuilt binary (GitHub releases of llama.cpp):
```bash
./llama-server -hf infosave/cortiq_qwopus_dev:Q4_K_M
./llama-cli -hf infosave/cortiq_qwopus_dev:Q4_K_M
```
### Python (llama-cpp-python)
Сниппет также берётся напрямую из страницы модели [page:1]:
```python
# pip install llama-cpp-python
from llama_cpp import Llama
llm = Llama.from_pretrained(
repo_id="infosave/cortiq_qwopus_dev",
filename="qwopus-nvg-12b-F16.gguf",
)
resp = llm.create_chat_completion(
messages=[
{"role": "user", "content": "Write a Python quicksort implementation."}
]
)
print(resp["choices"]["message"]["content"])
```
### Ollama
```bash
ollama run hf.co/infosave/cortiq_qwopus_dev:Q4_K_M
```
### LM Studio / Jan / Unsloth / другие клиенты
Модель уже интегрирована в стандартные “local apps” Hugging Face
(LLM Studio, Jan, Unsloth, Pi, Hermes Agent, Docker Model Runner, Lemonade и др.),
и может быть выбрана поиском по имени `infosave/cortiq_qwopus_dev` [page:1].
---
## Limitations
- Модель специализирована под код и агентные сценарии; для чисто
“общечатовых” задач необязательно будет оптимальна.
- Крайне длинный контекст с множеством файлов и инструкций может ухудшать
качество генерации.
- Не предназначена для формально верифицированной или safety‑critical разработки;
всегда проверяйте вывод перед использованием в проде.
---
## License
This model is released under the **MIT License** (as specified on the model
page). [page:1]
The underlying CORTIQ compression method is proprietary and patent‑pending.
Commercial use of the weights follows MIT; separate licensing may be required
for direct use of the CORTIQ pipeline itself.
---
## Citation
```bibtex
@misc{allaigate2026cortiq_qwopus_dev,
title = {Cortiq\_qwopus\_dev 12B:
Task-Specialized Coding via Dynamic Compression
from Qwopus3.6-27B-v2-MTP},
author = {AllAIGate},
year = {2026},
howpublished = {\url{https://huggingface.co/infosave/cortiq_qwopus_dev}},
note = {Base: Jackrong/Qwopus3.6-27B-v2-MTP-GGUF.
CORTIQ method: US Patent Application No. 19/452,464}
}
```