How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
Use Docker
docker model run hf.co/Krypto-Whitehat/qwen3.8-9b-cyber-exploit-agent:Q4_K_M
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Training Data β€” qwen3.8-9b-cyber-exploit-agent

This is the exact dataset the shipped model was trained on (QLoRA r16/a16, 3 epochs, best ckpt by eval loss).

  • train_all_v2_shipped.jsonl β€” 395 samples: 280 CyberGym train-config tasks (8 blacklisted oss-fuzz IDs removed, Elfsong eval-200 never trained on) + 33 XRPL samples x3 (code-verified gates F1-F22/D/E/N, real issue texts, no maintainer comments in user turns) + 16 own labs/boundary samples.
  • trackA.jsonl β€” Track A source samples (280).
  • labs/ + evidence/ β€” 14 locally compiled and triggered labs (ASan logs, Python RCE markers). No invented crashes.
  • scripts/ β€” full reproducible pipeline (dataset builders, SFT, merge, GGUF chain, eval gates).
  • inference_system.txt β€” the training system prompt; use it at inference.
  • train_ids.json / eval_ids.json β€” task id lists (train minus blacklist / eval holdout).

Dataset gate at build time: 0 blacklist ids, 0 user-turn leak markers, 0 schema violations, G1/G2/G6/G7/G8 verdicts pinned.

Downloads last month
106
GGUF
Model size
9B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support