Nitishsharma9's picture
Update README.md
e819883 verified
|
Raw
History Blame Contribute Delete
1.84 kB
---
license: apache-2.0
tags:
- qwen
- cybersecurity
- ethical-hacking
- coding
- gguf
- 4bit
---
# Super-Lite Cyber Coder 1.5B (GGUF)
This is a highly optimized, super-lite language model designed for **Clean, secure code generation, debugging, and authorized ethical hacking & penetration testing methodologies.**
It has been fine-tuned on coding and cybersecurity datasets, maintaining strict adherence to defensive and educational boundaries.
## Target Hardware
- **RAM Requirement:** < 4GB
- **Format:** GGUF (Q4_K_M)
- **Size:** < 1.2 GB
- **Context Length:** 2048 Tokens
## How to use with PocketPal AI (Mobile)
1. Download PocketPal AI from your device's app store.
2. Load the `super-lite-cyber-coder-q4_k_m.gguf` file directly into the app.
3. Configure the chat template to use ChatML (`<|im_start|>` / `<|im_end|>`).
4. Set the system prompt to enforce safe, authorized penetration testing boundaries.
## How to use with LM Studio / Ollama
- **Ollama:** Since you're on Windows, here’s the exact command to download and run it with Ollama:
- *ollama run hf.co/Nitishsharma9/super-lite-model-upload:Q4_K_M:*
## What this command does:
**ollama run: This tells Ollama to run a model.**
1. **hf.co/...: This is the special identifier that tells Ollama to look for the model on Hugging Face (hf.co is the short URL for huggingface.co).:**
2. **Nitishsharma9/super-lite-model-upload: This is the repository path on Hugging Face.:**
3. **:Q4_K_M: This specifies the exact quantization file (the .gguf file) to use, which matches the file you were trying to use earlier.:**
4. **When you run this command for the first time, Ollama will automatically download the model file from Hugging Face and store it locally. After the download finishes, you'll be placed directly into an interactive chat session with the model.:**