Instructions to use AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi new
How to use AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit
Run Hermes
hermes
- MLX LM
How to use AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
Titus-CybersecurityLLM-v1.0 MLX 4-bit
This repository contains the MLX 4-bit Apple Silicon variant of AlicanKiraz0/Titus-CybersecurityLLM-v1.0, a Turkish-first cybersecurity assistant fine-tuned from Qwen/Qwen3.6-35B-A3B.
The source model was trained on a 500K+ row cybersecurity instruction dataset built from a multi-dimensional security taxonomy, with an approximately 4B-parameter LoRA adaptation surface, then merged and converted for efficient local inference.
Variant Details
- Variant: MLX 4-bit
- Source model:
AlicanKiraz0/Titus-CybersecurityLLM-v1.0 - Base model:
Qwen/Qwen3.6-35B-A3B - Architecture:
qwen3_5_moe - Target runtime: Apple Silicon with MLX
- Primary language: Turkish cybersecurity assistance
Intended Use
Use this variant for local Apple Silicon workflows such as:
- SOC triage assistance
- DFIR checklists and investigation notes
- Detection engineering support
- Cloud, Kubernetes, IAM, endpoint, and AppSec reviews
- GRC and control-mapping drafts
- Authorized lab, CTF, purple-team, and defensive validation tasks
Dataset Taxonomy Summary
The source model was fine-tuned with a structured cybersecurity taxonomy covering:
- Security architecture, Zero Trust, hardening, and risk terminology
- Network, web, API, IAM, endpoint, cloud, Kubernetes, and DevSecOps security
- SOC, SIEM, detection engineering, SOAR, alert tuning, and telemetry gap analysis
- Incident response, DFIR, malware analysis, threat intelligence, and threat hunting
- Vulnerability management, offensive security in authorized settings, GRC, OT/ICS, mobile, AI/LLM security, and resilience
The dataset taxonomy combines:
- Domains and subdomains
- Task families: triage, artifact analysis, detection authoring, root cause analysis, remediation planning, executive summaries
- Artifacts: logs, EDR telemetry, SIEM alerts, IAM policies, K8s manifests, code/config snippets, email headers, CVE records, forensic excerpts
- Difficulty levels: L1 through L5, from fundamentals to expert strategic reasoning
- Safety labels: defensive, bounded dual-use, CTF/lab-only, and restricted/excluded
Example Usage
Install MLX tooling:
pip install -U mlx-lm
Generate:
mlx_lm.generate \
--model AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit \
--prompt "Windows hostta LSASS erişimi şüphesini doğrulamak için hangi telemetry alanlarına bakarsın?" \
--max-tokens 512 \
--temp 0
Notes
- This is a quantized convenience build for Apple Silicon inference.
- For maximum fidelity, use the BF16 merged safetensors model:
AlicanKiraz0/Titus-CybersecurityLLM-v1.0. - For CPU/GPU llama.cpp-style workflows, use the GGUF variant:
AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_0-GGUF.
Safety
This model is intended for authorized cybersecurity work. Use offensive or dual-use outputs only in controlled, legal, and explicitly authorized lab, CTF, red-team, purple-team, or detection validation contexts.
- Downloads last month
- 139
4-bit
Model tree for AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit
Base model
AlicanKiraz0/Titus-CybersecurityLLM-v1.0