Transformers
GGUF
security
cybersecwithai
threat
vulnerability
infosec
zysec.ai
cyber security
ai4security
llmsecurity
cyber
malware analysis
exploitdev
ai4good
aisecurity
cybersec
cybersecurity
conversational
Instructions to use QuantFactory/SecurityLLM-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use QuantFactory/SecurityLLM-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("QuantFactory/SecurityLLM-GGUF", dtype="auto") - llama-cpp-python
How to use QuantFactory/SecurityLLM-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="QuantFactory/SecurityLLM-GGUF", filename="SecurityLLM.Q2_K.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use QuantFactory/SecurityLLM-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf QuantFactory/SecurityLLM-GGUF:Q4_K_M
Use Docker
docker model run hf.co/QuantFactory/SecurityLLM-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use QuantFactory/SecurityLLM-GGUF with Ollama:
ollama run hf.co/QuantFactory/SecurityLLM-GGUF:Q4_K_M
- Unsloth Studio new
How to use QuantFactory/SecurityLLM-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/SecurityLLM-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/SecurityLLM-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for QuantFactory/SecurityLLM-GGUF to start chatting
- Docker Model Runner
How to use QuantFactory/SecurityLLM-GGUF with Docker Model Runner:
docker model run hf.co/QuantFactory/SecurityLLM-GGUF:Q4_K_M
- Lemonade
How to use QuantFactory/SecurityLLM-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull QuantFactory/SecurityLLM-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.SecurityLLM-GGUF-Q4_K_M
List all available models
lemonade list
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,91 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
|
| 4 |
+
library_name: transformers
|
| 5 |
+
license: apache-2.0
|
| 6 |
+
tags:
|
| 7 |
+
- security
|
| 8 |
+
- cybersecwithai
|
| 9 |
+
- threat
|
| 10 |
+
- vulnerability
|
| 11 |
+
- infosec
|
| 12 |
+
- zysec.ai
|
| 13 |
+
- cyber security
|
| 14 |
+
- ai4security
|
| 15 |
+
- llmsecurity
|
| 16 |
+
- cyber
|
| 17 |
+
- malware analysis
|
| 18 |
+
- exploitdev
|
| 19 |
+
- ai4good
|
| 20 |
+
- aisecurity
|
| 21 |
+
- threat
|
| 22 |
+
- cybersec
|
| 23 |
+
- cybersecurity
|
| 24 |
+
|
| 25 |
+
---
|
| 26 |
+
|
| 27 |
+
[](https://hf.co/QuantFactory)
|
| 28 |
+
|
| 29 |
+
|
| 30 |
+
# QuantFactory/SecurityLLM-GGUF
|
| 31 |
+
This is quantized version of [ZySec-AI/SecurityLLM](https://huggingface.co/ZySec-AI/SecurityLLM) created using llama.cpp
|
| 32 |
+
|
| 33 |
+
# Original Model Card
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
|
| 37 |
+
# ZySec-7B
|
| 38 |
+
|
| 39 |
+
ZySec-7B, stands as a pivotal innovation for security professionals, leveraging the advanced capabilities of HuggingFace's Zephyr language model series. This AI model is crafted to be an omnipresent cybersecurity ally, offering on-demand, expert guidance in cybersecurity issues. Picture ZySec-7B as an ever-present digital teammate, adept at navigating the complexities of security challenges.
|
| 40 |
+
|
| 41 |
+
The efficacy of ZySec-7B lies in its comprehensive training across numerous cybersecurity fields, providing a deep and wide-ranging understanding of the sector. ZySec is developed using the DPO technique, utilizing a varied dataset encompassing critical topics such as:
|
| 42 |
+
|
| 43 |
+
- Sophisticated areas like Attack Surface Threats, Cloud Security, and the Cyber Kill Chain.
|
| 44 |
+
- Key compliance and regulatory frameworks, including CIS Controls, FedRAMP, PCI DSS, and ISO/IEC 27001.
|
| 45 |
+
- Practical aspects like Cloud Secure Migration, Data Exfiltration Techniques, and Security Incident Handling.
|
| 46 |
+
- Crucial strategic fields such as Security Governance, Risk Management, and Security Architecture Review.
|
| 47 |
+
|
| 48 |
+
ZySec-7B's training spans over 30 unique domains, each enriched with thousands of data points, delivering unparalleled expertise.
|
| 49 |
+
|
| 50 |
+
As the first of its kind in an open-source, AI-driven cybersecurity series, ZySec-7B transcends the conventional role of a support tool, redefining organizational security approaches. Its open-source nature not only invites community contributions but also enhances its flexibility and transparency in managing vast cybersecurity data. ZySec-7B is instrumental in providing vital, actionable insights for strategic decision-making and advanced risk management. More than a mere software, ZySec-7B is a community-enhanced strategic tool, equipping your team to proactively confront and stay ahead of the dynamic landscape of cyber threats and regulatory demands.
|
| 51 |
+
|
| 52 |
+
|
| 53 |
+
|
| 54 |
+
# For suggestions please use [Road Map](https://zysec-ai.productlift.dev/t/roadmap)
|
| 55 |
+
|
| 56 |
+
<img src="https://huggingface.co/aihub-app/ZySec-7B-v1/resolve/main/ZySec-7B-dataset-composition.png?download=true" alt="Dataset Distribution" width="90%"/>
|
| 57 |
+
|
| 58 |
+
Details of dataset distribution here - [Dataset Distribution](https://huggingface.co/aihub-app/ZySec-7B/resolve/main/ZySec-7B-dataset-composition.png?download=true)
|
| 59 |
+
|
| 60 |
+
Fully compatible with [LM Studio](https://lmstudio.ai). Search for “Zysec” and here is what you get. Here is a sample output of ZySec writing email to John about database security using LM Studio:
|
| 61 |
+
|
| 62 |
+
<img src="https://huggingface.co/aihub-app/ZySec-7B-v1/resolve/main/sample-output.png" alt="Sample Output" width="90%"/>
|
| 63 |
+
|
| 64 |
+
---
|
| 65 |
+
|
| 66 |
+
The training is funded by [ZySec AI](https://www.zysec.app), the mobile app for Cyber Security professionals.
|
| 67 |
+
|
| 68 |
+
Official GGUF version is hosted here - [ZySec-7B-v1-GGUF on HuggingFace](https://huggingface.co/aihub-app/ZySec-7B-v1-GGUF)
|
| 69 |
+
|
| 70 |
+
|
| 71 |
+
## [ZySec AI: Unleashing the Potential of the ZySec Series Model](https://github.com/ZySec-AI/ZySec)
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
Project ZySec, an integral part of ZySec AI, stands at the forefront of integrating Artificial Intelligence into Cybersecurity. Centered around the innovative ZySec 7B model, it's designed to revolutionize the cybersecurity landscape with AI-driven solutions. ZySec AI isn't just a tool, it's a transformative approach, blending AI's cutting-edge capabilities with the unique intricacies of cybersecurity, while ensuring privacy and security.
|
| 75 |
+
|
| 76 |
+
|
| 77 |
+
### Discover the Key Features of Project ZySec
|
| 78 |
+
- **AI-Driven Cybersecurity:** Tap into the power of the ZySec 7B model, a bespoke AI solution fine-tuned for cybersecurity.
|
| 79 |
+
- **24/7 Expert Assistance:** Benefit from round-the-clock support and expert advice, guaranteeing smooth operations during any SOC shift.
|
| 80 |
+
- **Efficient Playbook Access:** Streamline your workflow with quick and easy access to playbooks and documents, enhancing information retrieval.
|
| 81 |
+
- **Standards Explorer:** Navigate various standards with ease, akin to a seasoned expert's proficiency.
|
| 82 |
+
- **Ongoing Internet Research:** Leverage AI-enabled, thorough internet research for exhaustive insights. (Note: Internet use is optional and specific to this feature).
|
| 83 |
+
|
| 84 |
+
### About Project ZySec by ZySec AI
|
| 85 |
+
ZySec AI an opensource project with a vision towards fusioning of Cybersecurity with Artificial Intelligence. Our goal is to transform the way security professionals engage with technology. More than a mere tool, ZySec AI symbolizes a comprehensive strategy to augment security operations, merging the innovative essence of AI with cybersecurity's distinctive challenges, always ensuring privacy and security.
|
| 86 |
+
|
| 87 |
+
https://github.com/ZySec-AI/ZySec
|
| 88 |
+
|
| 89 |
+
### The ZySec Roadmap
|
| 90 |
+
https://github.com/ZySec-AI/.github/blob/main/roadmap.md
|
| 91 |
+
|