Safetensors
GGUF
English
Spanish
qwen2
qwen
qwen2.5
cybersecurity
pentesting
red-team
unsloth
conversational
Instructions to use k3ssdev/Qwen2.5-Coder-3B-Pentest with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use k3ssdev/Qwen2.5-Coder-3B-Pentest with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M # Run inference directly in the terminal: llama cli -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M # Run inference directly in the terminal: llama cli -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
Use Docker
docker model run hf.co/k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use k3ssdev/Qwen2.5-Coder-3B-Pentest with Ollama:
ollama run hf.co/k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
- Unsloth Studio
How to use k3ssdev/Qwen2.5-Coder-3B-Pentest with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for k3ssdev/Qwen2.5-Coder-3B-Pentest to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for k3ssdev/Qwen2.5-Coder-3B-Pentest to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for k3ssdev/Qwen2.5-Coder-3B-Pentest to start chatting
- Docker Model Runner
How to use k3ssdev/Qwen2.5-Coder-3B-Pentest with Docker Model Runner:
docker model run hf.co/k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
- Lemonade
How to use k3ssdev/Qwen2.5-Coder-3B-Pentest with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull k3ssdev/Qwen2.5-Coder-3B-Pentest:Q4_K_M
Run and chat with the model
lemonade run user.Qwen2.5-Coder-3B-Pentest-Q4_K_M
List all available models
lemonade list
- Atomic Chat
File size: 5,920 Bytes
bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 bf7d355 29a4876 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 | ---
license: apache-2.0
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
tags:
- qwen
- qwen2.5
- cybersecurity
- pentesting
- red-team
- gguf
- unsloth
language:
- en
- es
datasets:
- tuandunghcmut/Trendyol-Cybersecurity-Instruction-Tuning-Dataset
---
# 🛡️ Qwen2.5-Coder-3B-Pentest (Red Team Copilot)
*[English Version below | Versión en Español más abajo]*
---
## 🇬🇧 English Version
This model is a specialized fine-tuning of **Qwen 2.5 Coder 3B Instruct**, designed to act as a **Tactical Copilot ("Hacking Buddy")** for offensive cybersecurity tasks, vulnerability analysis, and terminal command automation.
Being available in **GGUF** format and highly lightweight, it is strongly optimized for deployment in **Edge AI** environments (100% offline), such as Raspberry Pi or mobile devices integrated with C++ engines like `llama.cpp` or `lite-cpp-ai`.
### 🎯 Model Objective
Unlike a generalist LLM, this model has been fine-tuned to:
- **Technical Accuracy:** Generate exact flags for terminal tools (`nmap`, `netcat`, `tcpdump`, `iptables`).
- **Offensive/Defensive Scripts:** Automate security tasks in Python (e.g., using `scapy`, `requests`).
- **Rapid Analysis:** Interpret network traces and security logs.
### 🛠️ Training Details
- **Base Model:** `Qwen/Qwen2.5-Coder-3B-Instruct`
- **Technique:** QLoRA (Rank 32, Alpha 32)
- **Framework:** Unsloth
- **Dataset:** `tuandunghcmut/Trendyol-Cybersecurity-Instruction-Tuning-Dataset`
- **Training Hardware:** NVIDIA RTX 4080 (Local)
### 💻 How to Use
#### Option A: Offline Use (Recommended - GGUF)
The repository includes the quantized file `Qwen2.5-Coder-3B-Pentest-Q4_K_M.gguf`. You can run it with `llama.cpp`:
```bash
./llama-cli -m Qwen2.5-Coder-3B-Pentest-Q4_K_M.gguf -p "Write an nmap command to scan for hidden UDP ports."
```
#### Option B: Use with Transformers (Python)
You can load the full tensors (`.safetensors`) using the standard Hugging Face library:
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "k3ssdev/Qwen2.5-Coder-3B-Pentest"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
prompt = "Generate a Python script to discover hosts on a local network."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0]))
```
### ⚠️ Legal and Intended Use Disclaimer
**This model is provided EXCLUSIVELY for educational purposes, research, and authorized security audits (Red Teaming / Blue Teaming).**
* The model lacks certain alignment filters (censorship) in order to analyze malicious code and generate Proof of Concepts (PoCs).
* The user is solely responsible for ensuring they have explicit and legal permission to evaluate or attack any network infrastructure.
* The creator of this model is not responsible for any direct or indirect damage resulting from the misuse of the commands or scripts generated by this AI.
---
## 🇪🇸 Versión en Español
Este modelo es un *fine-tuning* especializado de **Qwen 2.5 Coder 3B Instruct**, diseñado para actuar como un **Copiloto Táctico ("Hacking Buddy")** en tareas de ciberseguridad ofensiva, análisis de vulnerabilidades y automatización de comandos de terminal.
Al estar disponible en formato **GGUF** y pesar poco, está fuertemente optimizado para ser desplegado en entornos **Edge AI** (100% offline), como Raspberry Pi o dispositivos móviles integrados con motores C++ como `llama.cpp` o `lite-cpp-ai`.
### 🎯 Objetivo del Modelo
A diferencia de un LLM generalista, este modelo ha sido ajustado para:
* **Precisión Técnica:** Generar flags exactas para herramientas de terminal (`nmap`, `netcat`, `tcpdump`, `iptables`).
* **Scripts Ofensivos/Defensivos:** Automatizar tareas de seguridad en Python (ej. uso de `scapy`, `requests`).
* **Análisis Rápido:** Interpretar trazas de red y *logs* de seguridad.
### 🛠️ Detalles del Entrenamiento
* **Modelo Base:** `Qwen/Qwen2.5-Coder-3B-Instruct`
* **Técnica:** QLoRA (Rank 32, Alpha 32)
* **Framework:** Unsloth
* **Dataset:** `tuandunghcmut/Trendyol-Cybersecurity-Instruction-Tuning-Dataset`
* **Hardware de Entrenamiento:** NVIDIA RTX 4080 (Local)
### 💻 Cómo utilizarlo
#### Opción A: Uso Offline (Recomendado - GGUF)
El repositorio incluye el archivo cuantizado `Qwen2.5-Coder-3B-Pentest-Q4_K_M.gguf`. Puedes ejecutarlo con `llama.cpp`:
```bash
./llama-cli -m Qwen2.5-Coder-3B-Pentest-Q4_K_M.gguf -p "Escribe un comando nmap para escanear puertos UDP ocultos."
```
#### Opción B: Uso con Transformers (Python)
Puedes cargar los tensores completos (`.safetensors`) usando la librería estándar de Hugging Face:
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "k3ssdev/Qwen2.5-Coder-3B-Pentest"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
prompt = "Genera un script en Python para descubrir hosts en una red local."
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0]))
```
### ⚠️ Disclaimer Legal y de Uso (Intended Use)
**Este modelo se proporciona EXCLUSIVAMENTE con fines educativos, de investigación y para auditorías de seguridad autorizadas (Red Teaming / Blue Teaming).**
* El modelo carece de ciertos filtros de alineación (censura) para poder analizar código malicioso y generar pruebas de concepto (PoCs).
* El usuario es el único responsable de asegurar que tiene permiso explícito y legal para evaluar o atacar cualquier infraestructura de red.
* El creador del modelo no se hace responsable de los daños directos o indirectos derivados del mal uso de los comandos o scripts generados por esta IA.
``` |