fawazo commited on
Commit
14beb21
·
verified ·
1 Parent(s): 7cea688

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +91 -0
README.md ADDED
@@ -0,0 +1,91 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-Coder-3B
3
+ tags:
4
+ - gguf
5
+ - llama.cpp
6
+ - pentesting
7
+ - cybersecurity
8
+ - jetson
9
+ - quantized
10
+ ---
11
+
12
+ # Qwen2.5-Coder-3B Pentest - GGUF
13
+
14
+ GGUF quantizations of [fawazo/qwen2.5-coder-3b-pentest](https://huggingface.co/fawazo/qwen2.5-coder-3b-pentest) optimized for **Jetson Orin Nano (8GB)**.
15
+
16
+ ## Model Description
17
+
18
+ An AI pentesting assistant fine-tuned on 150K+ cybersecurity examples covering:
19
+ - OWASP Top 10 vulnerabilities
20
+ - MITRE ATT&CK framework
21
+ - API security testing
22
+ - Web application penetration testing
23
+
24
+ **Output Format:** JSON for automation
25
+
26
+ ## Quantizations
27
+
28
+ | File | Size | RAM Needed | Recommended For |
29
+ |------|------|------------|-----------------|
30
+ | `qwen2.5-coder-3b-pentest-q4_k_m.gguf` | ~1.8GB | ~3GB | **Jetson Orin Nano 8GB** |
31
+ | `qwen2.5-coder-3b-pentest-q5_k_m.gguf` | ~2.1GB | ~4GB | Better quality |
32
+ | `qwen2.5-coder-3b-pentest-q8_0.gguf` | ~3.4GB | ~5GB | Best quality |
33
+ | `qwen2.5-coder-3b-pentest-f16.gguf` | ~6GB | ~8GB | Full precision |
34
+
35
+ ## Usage on Jetson
36
+
37
+ ### With Ollama
38
+ ```bash
39
+ # Download Q4_K_M (recommended for 8GB)
40
+ huggingface-cli download fawazo/qwen2.5-coder-3b-pentest-gguf qwen2.5-coder-3b-pentest-q4_k_m.gguf
41
+
42
+ # Create Modelfile
43
+ cat > Modelfile << 'EOF'
44
+ FROM ./qwen2.5-coder-3b-pentest-q4_k_m.gguf
45
+
46
+ SYSTEM """You are an expert penetration testing AI assistant. Analyze web traffic and respond with JSON:
47
+ {"action": "report|request|command|complete", ...}"""
48
+
49
+ PARAMETER temperature 0.3
50
+ PARAMETER num_ctx 2048
51
+ EOF
52
+
53
+ # Create and run
54
+ ollama create pentest-agent -f Modelfile
55
+ ollama run pentest-agent
56
+ ```
57
+
58
+ ### With llama.cpp
59
+ ```bash
60
+ ./llama-cli -m qwen2.5-coder-3b-pentest-q4_k_m.gguf -ngl 99 -c 2048 -p "Analyze this request..."
61
+ ```
62
+
63
+ ## Example Usage
64
+
65
+ **Input:**
66
+ ```
67
+ Analyze this HTTP exchange:
68
+ REQUEST: GET /api/users?id=1
69
+ RESPONSE: {"user": "admin", "role": "administrator"}
70
+ ```
71
+
72
+ **Output:**
73
+ ```json
74
+ {
75
+ "action": "request",
76
+ "method": "GET",
77
+ "path": "/api/users?id=2",
78
+ "reasoning": "Testing for IDOR - checking if user IDs are enumerable"
79
+ }
80
+ ```
81
+
82
+ ## Training Details
83
+
84
+ - **Base:** Qwen/Qwen2.5-Coder-3B
85
+ - **Method:** SFT with LoRA (r=32)
86
+ - **Dataset:** 150K+ combined examples from Trendyol, Fenrir v2.0, pentest-agent
87
+ - **Frameworks:** OWASP, MITRE ATT&CK, NIST CSF
88
+
89
+ ## License
90
+
91
+ Apache 2.0 (inherits from base model and training datasets)