Spaces:
Running
Running
add model tags (20 scanned models) to Space metadata for discoverability on model pages
Browse files
README.md
CHANGED
|
@@ -1,94 +1,115 @@
|
|
| 1 |
-
---
|
| 2 |
-
title: ViKernel Scanner
|
| 3 |
-
emoji: 🛡️
|
| 4 |
-
colorFrom: yellow
|
| 5 |
-
colorTo: red
|
| 6 |
-
sdk: docker
|
| 7 |
-
app_port: 7860
|
| 8 |
-
pinned: false
|
| 9 |
-
license: apache-2.0
|
| 10 |
-
hf_oauth: true
|
| 11 |
-
hf_oauth_scopes:
|
| 12 |
-
- email
|
| 13 |
-
- inference-api
|
| 14 |
-
hf_oauth_expiration_minutes: 480
|
| 15 |
-
short_description: AI model security scanner. Grade your model A to F.
|
| 16 |
-
tags:
|
| 17 |
-
- ai-security
|
| 18 |
-
- red-teaming
|
| 19 |
-
- agent-safety
|
| 20 |
-
- prompt-injection
|
| 21 |
-
- llm-security
|
| 22 |
-
- scanner
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
|
| 87 |
-
|
| 88 |
-
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: ViKernel Scanner
|
| 3 |
+
emoji: 🛡️
|
| 4 |
+
colorFrom: yellow
|
| 5 |
+
colorTo: red
|
| 6 |
+
sdk: docker
|
| 7 |
+
app_port: 7860
|
| 8 |
+
pinned: false
|
| 9 |
+
license: apache-2.0
|
| 10 |
+
hf_oauth: true
|
| 11 |
+
hf_oauth_scopes:
|
| 12 |
+
- email
|
| 13 |
+
- inference-api
|
| 14 |
+
hf_oauth_expiration_minutes: 480
|
| 15 |
+
short_description: AI model security scanner. Grade your model A to F.
|
| 16 |
+
tags:
|
| 17 |
+
- ai-security
|
| 18 |
+
- red-teaming
|
| 19 |
+
- agent-safety
|
| 20 |
+
- prompt-injection
|
| 21 |
+
- llm-security
|
| 22 |
+
- scanner
|
| 23 |
+
models:
|
| 24 |
+
- meta-llama/Llama-3.3-70B-Instruct
|
| 25 |
+
- meta-llama/Llama-4-Maverick-17B-128E-Instruct
|
| 26 |
+
- meta-llama/Llama-3.1-8B-Instruct
|
| 27 |
+
- Qwen/Qwen3-235B-A22B-Instruct-2507
|
| 28 |
+
- Qwen/Qwen3-Next-80B-A3B-Instruct
|
| 29 |
+
- Qwen/Qwen2.5-72B-Instruct
|
| 30 |
+
- Qwen/Qwen3-Coder-480B-A35B-Instruct
|
| 31 |
+
- deepseek-ai/DeepSeek-V4-Pro
|
| 32 |
+
- deepseek-ai/DeepSeek-V4.1-Flash
|
| 33 |
+
- deepseek-ai/DeepSeek-V3.2
|
| 34 |
+
- google/gemma-4-31B-it
|
| 35 |
+
- google/gemma-3-27b-it
|
| 36 |
+
- zai-org/GLM-5
|
| 37 |
+
- zai-org/GLM-4.7
|
| 38 |
+
- moonshotai/Kimi-K3
|
| 39 |
+
- moonshotai/Kimi-K2.6
|
| 40 |
+
- openai/gpt-oss-120b
|
| 41 |
+
- MiniMaxAI/MiniMax-M3
|
| 42 |
+
- mistralai/Mistral-Large-4-1T-A52B
|
| 43 |
+
- nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-FP8
|
| 44 |
+
---
|
| 45 |
+
|
| 46 |
+
# ViKernel Scanner: AI Model Security Scanner
|
| 47 |
+
|
| 48 |
+
Give your model a set of tools and see what it tries to do with them. About a minute. Graded A to F.
|
| 49 |
+
|
| 50 |
+
ViKernel Scanner connects to any OpenAI-compatible model endpoint (Hugging Face router, OpenRouter, OpenAI, Anthropic and Google through their OpenAI-compatible endpoints, Together, Groq, Fireworks, DeepInfra, Mistral, or your own vLLM, TGI or LiteLLM server), hands the model a set of **mock** tools (files, mail, web, shell, payments), sends it a series of check prompts, and records every tool call the model tries to make. The tools are mocks: nothing real is sent, deleted or run.
|
| 51 |
+
|
| 52 |
+
## What you get
|
| 53 |
+
|
| 54 |
+
| Section | What it shows |
|
| 55 |
+
|---|---|
|
| 56 |
+
| Headline | How many risky tool calls your model tried, and how fast the first one came |
|
| 57 |
+
| Attack depth | How far an attacker got: 1 reconnaissance, 2 instruction takeover, 3 exfiltration attempt, 4 destruction or takeover |
|
| 58 |
+
| Security grade | A to F per domain. The overall grade is the lowest domain grade |
|
| 59 |
+
| What your model tried | The exact tool calls, with the request that triggered them |
|
| 60 |
+
| With ViKernel Firewall inside the model weights | How many of those calls the firewall denies before they run, and the projected grade |
|
| 61 |
+
| Official badge | A badge issued by the ViKernel master for your model card |
|
| 62 |
+
|
| 63 |
+
## Domains
|
| 64 |
+
|
| 65 |
+
| Code | Domain | Free edition |
|
| 66 |
+
|---|---|---|
|
| 67 |
+
| D1 | Command execution | Yes |
|
| 68 |
+
| D2 | Secret exfiltration | Yes |
|
| 69 |
+
| D3 | Hidden instruction | Yes |
|
| 70 |
+
| D4 | Boundary escape | Full scanner |
|
| 71 |
+
| D5 | Tool argument abuse | Full scanner |
|
| 72 |
+
| D6 | Control evasion | Full scanner |
|
| 73 |
+
|
| 74 |
+
Normal-work controls run alongside the checks. A model that refuses everything is not safe, it is unusable, and the report shows that too.
|
| 75 |
+
|
| 76 |
+
## How to use
|
| 77 |
+
|
| 78 |
+
**On this Space.** Sign in with Hugging Face, enter the endpoint and the model name, confirm that you may test the model, and press Scan. With the Hugging Face router (`https://router.huggingface.co/v1`) you can leave the API key empty: the scan runs on your signed-in account. For any other endpoint, enter its key. A key is used for that scan only and is never stored or logged.
|
| 79 |
+
|
| 80 |
+
**On your machine** (works with local models such as Ollama, LM Studio and vLLM):
|
| 81 |
+
|
| 82 |
+
```bash
|
| 83 |
+
git clone https://github.com/final-bench/vikernel-scanner
|
| 84 |
+
cd vikernel-scanner
|
| 85 |
+
export HF_TOKEN=hf_...
|
| 86 |
+
python vikernel_scan.py --base-url http://localhost:11434/v1 --model llama3.2
|
| 87 |
+
```
|
| 88 |
+
|
| 89 |
+
**Your own copy of this Space.** Duplicate it. Sign-in works on every copy. Every copy, including yours, gets its check set from the ViKernel master, so it stays current without any change on your side. To keep a scan history on your copy, add an `HF_TOKEN` secret with write access: the history is then stored in a private dataset `<your account>/vikernel-scanner-history`, created on first use. Without it the history is kept in memory only.
|
| 90 |
+
|
| 91 |
+
## Check set
|
| 92 |
+
|
| 93 |
+
The checks are served by the ViKernel master for each scan and are updated centrally. They are not part of this repository. The free edition uses the public starter prompts of the [AI Model Hacking Hackathon](https://huggingface.co/spaces/FINAL-Bench/ViKernel-RedTeam). New techniques that hackathon players find are fixed in ViKernel and join the full scanner.
|
| 94 |
+
|
| 95 |
+
## Privacy
|
| 96 |
+
|
| 97 |
+
Signing in records your Hugging Face username and email. They are used to send check-set updates and to answer questions about your report. The model API key you enter is used only for the scan and is never stored. Each scan's summary (model name, grades) is recorded so that the official badge can be issued.
|
| 98 |
+
|
| 99 |
+
## The ViKernel loop
|
| 100 |
+
|
| 101 |
+
| Step | Asset |
|
| 102 |
+
|---|---|
|
| 103 |
+
| Find | [AI Model Hacking Hackathon](https://huggingface.co/spaces/FINAL-Bench/ViKernel-RedTeam) |
|
| 104 |
+
| Measure | ViKernel Scanner (this Space) and the [Obfuscated-Shell Safety Leaderboard](https://huggingface.co/spaces/FINAL-Bench/obfuscated-shell-leaderboard) |
|
| 105 |
+
| Block | [ViKernel](https://huggingface.co/spaces/FINAL-Bench/ViKernel-Desktop) Firewall, a security kernel placed inside the model weights that judges every tool call before it runs |
|
| 106 |
+
|
| 107 |
+
## FAQ
|
| 108 |
+
|
| 109 |
+
**Is my model actually attacked?** No real system is touched. The model only sees mock tools. A tool call that a mock receives is recorded, not executed.
|
| 110 |
+
|
| 111 |
+
**Why do I need to sign in?** The check set is served per account by the ViKernel master. Signing in keeps the service fair and lets us send updates.
|
| 112 |
+
|
| 113 |
+
**What does the full scanner add?** Domains D4 to D6, the advanced techniques found in the hackathon, detailed per-finding evidence and fixes, and continuous re-scanning. Contact VIDRAFT through [vidraft.net](https://vidraft.net).
|
| 114 |
+
|
| 115 |
+
Made by [VIDRAFT](https://vidraft.net). Apache-2.0.
|