Text Generation
Transformers
Safetensors
English
qwen2
1.5b
domain-specialist
fableforge
nexus
no-refusals
security
uncensored
conversational
text-generation-inference
Instructions to use fableforge-ai/NEXUS-Security with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use fableforge-ai/NEXUS-Security with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="fableforge-ai/NEXUS-Security") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("fableforge-ai/NEXUS-Security") model = AutoModelForCausalLM.from_pretrained("fableforge-ai/NEXUS-Security") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use fableforge-ai/NEXUS-Security with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "fableforge-ai/NEXUS-Security" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/NEXUS-Security", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/fableforge-ai/NEXUS-Security
- SGLang
How to use fableforge-ai/NEXUS-Security with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "fableforge-ai/NEXUS-Security" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/NEXUS-Security", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "fableforge-ai/NEXUS-Security" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "fableforge-ai/NEXUS-Security", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use fableforge-ai/NEXUS-Security with Docker Model Runner:
docker model run hf.co/fableforge-ai/NEXUS-Security
| license: apache-2.0 | |
| language: | |
| - en | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - 1.5b | |
| - domain-specialist | |
| - fableforge | |
| - nexus | |
| - no-refusals | |
| - security | |
| - text-generation | |
| - uncensored | |
| # NEXUS-Security | |
| > **NEXUS domain specialist for security research, pentesting and defensive tooling β lightweight & uncensored.** | |
| [](https://huggingface.co/fableforge-ai/NEXUS-Security) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) | |
| Base model: [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) Β· Part of the **FableForge** ecosystem. | |
| ## π Benchmarks β 144/150 (96%) | |
| A 1.5B model scoring **96%** β punching far above its weight. 30-prompt evaluation (domain knowledge, uncensored domain + general, reasoning, tool use), 0β5 scoring, run on an NVIDIA A40 via Ollama. | |
| | Category | Score | Avg | | |
| | --- | --- | --- | | |
| | π― Domain Knowledge | 49/50 | 4.9/5 | | |
| | π Uncensored (Domain) | 25/25 | 5.0/5 | | |
| | π Uncensored (General) | 25/25 | 5.0/5 | | |
| | π§ Reasoning | 23/25 | 4.6/5 | | |
| | π§ Tool Use | 22/25 | 4.4/5 | | |
| | **Total** | **144/150** | **96%** | | |
| ## 𧬠The NEXUS Family β six specialists, one tiny footprint | |
| | Model | Score | Specialty | | |
| | --- | --- | --- | | |
| | [NEXUS-Coder](https://huggingface.co/King3Djbl/nexus-coder-GGUF) | 141/150 | Software Engineering & Code | | |
| | **NEXUS-Security** | **144/150** | **Cybersecurity & Hacking** | | |
| | [NEXUS-Medical](https://huggingface.co/King3Djbl/nexus-medical-GGUF) | 140/150 | Medicine & Healthcare | | |
| | [NEXUS-Legal](https://huggingface.co/King3Djbl/nexus-legal-GGUF) | 139/150 | Law & Compliance | | |
| | [NEXUS-Finance](https://huggingface.co/King3Djbl/nexus-finance-GGUF) | 144/150 | Finance & Accounting | | |
| | [NEXUS-Science](https://huggingface.co/King3Djbl/nexus-science-GGUF) | 140/150 | Science & Research | | |
| π Grab the whole family on [Ollama](https://ollama.com/fableforge-ai) or [Hugging Face](https://huggingface.co/King3Djbl). | |
| --- | |
| ## β‘ Run it now β Ollama | |
| ```bash | |
| ollama run fableforge-ai/nexus-security:q4_k_m # published on ollama.com | |
| ollama run hf.co/King3Djbl/nexus-security-GGUF:Q4_K_M | |
| ``` | |
| π¦ **GGUF quants:** [King3Djbl/nexus-security-GGUF](https://huggingface.co/King3Djbl/nexus-security-GGUF) | |
| ## π§ Prompt format (ChatML) | |
| ``` | |
| <|im_start|>system | |
| {system_prompt}<|im_end|> | |
| <|im_start|>user | |
| {prompt}<|im_end|> | |
| <|im_start|>assistant | |
| ``` | |
| ## π See it live β the FableForge demos | |
| This family powers a galaxy of free, interactive HF Spaces: | |
| - π§ [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) | |
| - πΊ [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc) | |
| - π [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator) | |
| - π» [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal) | |
| - π» [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer) | |
| --- | |
| *β Like & share β it helps people find the source instead of a mirror.* |