Text Generation
GGUF
English
Arabic
Turkish
qwen3
conversational
osint
cybersecurity
fine-tuned
security
intelligence
Instructions to use aab20abdullah/qwen_OSINT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use aab20abdullah/qwen_OSINT with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="aab20abdullah/qwen_OSINT", filename="qwen3-4b-thinking-2507.Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use aab20abdullah/qwen_OSINT with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M # Run inference directly in the terminal: llama-cli -hf aab20abdullah/qwen_OSINT:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M # Run inference directly in the terminal: llama-cli -hf aab20abdullah/qwen_OSINT:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf aab20abdullah/qwen_OSINT:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf aab20abdullah/qwen_OSINT:Q4_K_M
Use Docker
docker model run hf.co/aab20abdullah/qwen_OSINT:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use aab20abdullah/qwen_OSINT with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aab20abdullah/qwen_OSINT" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aab20abdullah/qwen_OSINT", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/aab20abdullah/qwen_OSINT:Q4_K_M
- Ollama
How to use aab20abdullah/qwen_OSINT with Ollama:
ollama run hf.co/aab20abdullah/qwen_OSINT:Q4_K_M
- Unsloth Studio new
How to use aab20abdullah/qwen_OSINT with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for aab20abdullah/qwen_OSINT to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for aab20abdullah/qwen_OSINT to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for aab20abdullah/qwen_OSINT to start chatting
- Pi new
How to use aab20abdullah/qwen_OSINT with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "aab20abdullah/qwen_OSINT:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use aab20abdullah/qwen_OSINT with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf aab20abdullah/qwen_OSINT:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default aab20abdullah/qwen_OSINT:Q4_K_M
Run Hermes
hermes
- Docker Model Runner
How to use aab20abdullah/qwen_OSINT with Docker Model Runner:
docker model run hf.co/aab20abdullah/qwen_OSINT:Q4_K_M
- Lemonade
How to use aab20abdullah/qwen_OSINT with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aab20abdullah/qwen_OSINT:Q4_K_M
Run and chat with the model
lemonade run user.qwen_OSINT-Q4_K_M
List all available models
lemonade list
File size: 8,896 Bytes
0b5de67 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 2255f2c 2f02057 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 | ---
base_model: Qwen/Qwen3-4B
language:
- en
- ar
- tr
license: apache-2.0
library_name: gguf
tags:
- gguf
- qwen3
- conversational
- osint
- cybersecurity
- fine-tuned
- security
- intelligence
pipeline_tag: text-generation
model_name: Qwen-OSINT
quantized_by: aab20abdullah
---
# Qwen-OSINT
<div align="center">
<img src="https://img.shields.io/badge/Model-Qwen2.5--7B-blue?style=flat-square" alt="Model">
<img src="https://img.shields.io/badge/License-Apache%202.0-green?style=flat-square" alt="License">
<img src="https://img.shields.io/badge/Task-OSINT-orange?style=flat-square" alt="Task">
<img src="https://img.shields.io/badge/Dataset-Multi--source-red?style=flat-square" alt="Dataset">
</div>
---
## π Table of Contents
- [Overview](#overview)
- [Features](#features)
- [Model Details](#model-details)
- [Installation](#installation)
- [Quick Start](#quick-start)
- [Usage Examples](#usage-examples)
- [Ethical Guidelines](#ethical-guidelines)
- [Limitations](#limitations)
- [License](#license)
- [Acknowledgments](#acknowledgments)
---
## π― Overview
**Qwen-OSINT** is a specialized large language model fine-tuned from [Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) specifically designed for Open Source Intelligence (OSINT) operations. This model leverages advanced natural language processing capabilities to assist security researchers, analysts, and investigators in gathering, analyzing, and synthesizing information from publicly available sources.
### What is OSINT?
Open Source Intelligence (OSINT) refers to the practice of collecting and analyzing information from publicly available sources to support decision-making processes. This includes data from:
- π Social media platforms
- π° News articles and publications
- π Search engines and databases
- πΌ Professional networks
- π Public records and government databases
---
## β¨ Features
| Feature | Description |
|---------|-------------|
| π **Advanced Search Analysis** | Efficiently analyzes search queries and identifies relevant intelligence sources |
| π **Data Synthesis** | Consolidates information from multiple sources into coherent summaries |
| π **Security Analysis** | Supports threat analysis and vulnerability assessment tasks |
| π **Report Generation** | Generates structured intelligence reports in various formats |
| π **Multi-language Support** | Processes and analyzes content in multiple languages |
| π‘οΈ **Ethical Compliance** | Built with safety guidelines to ensure responsible use |
---
## π Model Details
| Attribute | Value |
|-----------|-------|
| **Base Model** | Qwen2.5-7B-Instruct |
| **Framework** | Transformers (Hugging Face) |
| **Training Method** | Supervised Fine-tuning (SFT) |
| **Vocabulary Size** | 151,669 tokens |
| **Architecture** | Transformer-based Decoder |
| **Precision** | FP16 / INT8 compatible |
### Training Configuration
```
- Learning Rate: 2e-5
- Batch Size: 8
- Epochs: 3
- Warmup Steps: 100
- Max Sequence Length: 8192
```
---
## π§ Installation
### Prerequisites
```
Python >= 3.8
PyTorch >= 2.0
transformers >= 4.35.0
accelerate >= 0.20.0
bitsandbytes >= 0.40.0 (for quantization)
```
### Install Dependencies
```bash
pip install transformers torch accelerate bitsandbytes
```
### Download the Model
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "aab20abdullah/qwen_OSINT"
# Download tokenizer
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
# Download model
model = AutoModelForCausalLM.from_pretrained(
model_name,
device_map="auto",
trust_remote_code=True
)
```
---
## π Quick Start
### Basic Usage
```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "aab20abdullah/qwen_OSINT"
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True)
def generate_intelligence(prompt, max_length=512):
messages = [{"role": "user", "content": prompt}]
text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer([text], return_tensors="pt").to("cuda")
outputs = model.generate(
**inputs,
max_new_tokens=max_length,
temperature=0.7,
top_p=0.9
)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
return response.split("assistant")[-1].strip()
# Example
result = generate_intelligence("Analyze the key elements of a threat intelligence report.")
print(result)
```
### Quantized Version (Lower Memory Usage)
```python
from transformers import AutoModelForCausalLM, BitsAndBytesConfig
quantization_config = BitsAndBytesConfig(
load_in_8bit=True
)
model = AutoModelForCausalLM.from_pretrained(
model_name,
quantization_config=quantization_config,
device_map="auto",
trust_remote_code=True
)
```
---
## π‘ Usage Examples
### Example 1: Search Query Analysis
```python
prompt = """Analyze the following search query and suggest improvements for OSINT research:
Query: "site:linkedin.com cybersecurity analyst" """
result = generate_intelligence(prompt)
print(result)
```
### Example 2: Data Source Evaluation
```python
prompt = """Evaluate the reliability and credibility of the following OSINT sources:
1. Government statistical databases
2. Academic research papers
3. Social media platforms
4. Open-source code repositories"""
result = generate_intelligence(prompt)
print(result)
```
### Example 3: Threat Analysis Framework
```python
prompt = """Using the MITRE ATT&CK framework, analyze potential threat vectors for:
- Phishing attacks
- Network intrusion
- Data exfiltration
Provide recommendations for detection and prevention."""
result = generate_intelligence(prompt)
print(result)
```
---
## π‘οΈ Ethical Guidelines
> β οΈ **IMPORTANT**: This model is designed for **legitimate OSINT research** only.
### Acceptable Use Cases β
- π Security research and vulnerability assessment
- π Threat intelligence analysis
- π‘οΈ Organizational security posture evaluation
- π Academic research in cybersecurity
- π’ Corporate due diligence
### Prohibited Use Cases β
- π« Unauthorized surveillance
- π« Invasion of privacy
- π« Harassment or stalking
- π« Illegal activities
- π« Content generation for malicious purposes
### Responsible Use Principles
1. **Transparency**: Clearly identify yourself when conducting OSINT operations
2. **Legality**: Ensure compliance with applicable laws and regulations
3. **Proportionality**: Collect only information necessary for your objectives
4. **Security**: Protect collected data appropriately
5. **Accountability**: Maintain records of your OSINT activities
---
## β οΈ Limitations
| Limitation | Description |
|------------|-------------|
| β‘ **Computational Resources** | Requires GPU with sufficient VRAM for optimal performance |
| π― **Accuracy** | May generate plausible but incorrect information - always verify |
| π **Language Coverage** | Best performance in English; other languages may vary |
| π
**Knowledge Cutoff** | Training data has a knowledge cutoff date |
| π **Sensitive Data** | Not designed to handle highly classified or sensitive information |
---
## π License
This model is released under the **Apache 2.0 License**.
```
Copyright 2024 aab20abdullah
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
```
### Base Model License
The base model [Qwen2.5](https://huggingface.co/Qwen/Qwen2.5-7B) is licensed under the [Qwen Research License](https://github.com/QwenLM/Qwen2/blob/main/Qwen2.5_LICENSE).
---
## π Acknowledgments
- **Alibaba Cloud** - For developing the Qwen2.5 model architecture
- **Hugging Face** - For providing the model hosting infrastructure
- **Open Source Community** - For continuous contributions to AI safety and ethics
---
## π¬ Contact
- **Model Repository**: [huggingface.co/aab20abdullah/qwen_OSINT](https://huggingface.co/aab20abdullah/qwen_OSINT)
- **Author**: [aab20abdullah](https://huggingface.co/aab20abdullah)
---
## π Citation
If you use this model in your research or project, please cite:
```bibtex
@model{qwen_osint,
author = {aab20abdullah},
title = {Qwen-OSINT: A Specialized Model for Open Source Intelligence},
year = {2024},
publisher = {Hugging Face},
url = {https://huggingface.co/aab20abdullah/qwen_OSINT}
}
```
---
<div align="center">
<p>β If you find this model useful, please consider giving it a star!</p>
<p>Made with β€οΈ for the OSINT community</p>
</div> |