Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -54,7 +54,7 @@ Built for [RhythmAI](https://github.com/SyedCode01) -- an AI-powered SOC platfor
|
|
| 54 |
| **LoRA Dropout** | 0.05 |
|
| 55 |
| **Target Modules** | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
|
| 56 |
| **Training Precision** | 4-bit QLoRA with BF16 compute |
|
| 57 |
-
| **Context Length** |
|
| 58 |
| **GGUF Format** | MXFP4 (13 GB) |
|
| 59 |
| **License** | Apache 2.0 (inherited from GPT-OSS) |
|
| 60 |
|
|
@@ -192,7 +192,7 @@ This model is designed for cybersecurity professionals, SOC analysts, and securi
|
|
| 192 |
- **Domain-specific**: Optimized for cybersecurity tasks; general knowledge may be less reliable than the base model
|
| 193 |
- **Not a replacement for human analysts**: Outputs should be validated by qualified security professionals
|
| 194 |
- **Training data bias**: Performance may vary for threats or attack patterns not well-represented in the training data
|
| 195 |
-
- **Context window**:
|
| 196 |
- **No real-time data**: The model does not have access to real-time threat intelligence feeds
|
| 197 |
|
| 198 |
## Citation
|
|
@@ -200,7 +200,7 @@ This model is designed for cybersecurity professionals, SOC analysts, and securi
|
|
| 200 |
```bibtex
|
| 201 |
@misc{rhythmai-cybersec-20b,
|
| 202 |
title={RhythmAI Cybersec 20B: A Fine-Tuned Cybersecurity Language Model},
|
| 203 |
-
author={Syed Hasan
|
| 204 |
year={2026},
|
| 205 |
url={https://huggingface.co/SyedCode01/rhythmai-cybersec-20b},
|
| 206 |
note={Fine-tuned from OpenAI GPT-OSS-20B for SOC operations}
|
|
|
|
| 54 |
| **LoRA Dropout** | 0.05 |
|
| 55 |
| **Target Modules** | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
|
| 56 |
| **Training Precision** | 4-bit QLoRA with BF16 compute |
|
| 57 |
+
| **Context Length** | 65,536 tokens (64K) |
|
| 58 |
| **GGUF Format** | MXFP4 (13 GB) |
|
| 59 |
| **License** | Apache 2.0 (inherited from GPT-OSS) |
|
| 60 |
|
|
|
|
| 192 |
- **Domain-specific**: Optimized for cybersecurity tasks; general knowledge may be less reliable than the base model
|
| 193 |
- **Not a replacement for human analysts**: Outputs should be validated by qualified security professionals
|
| 194 |
- **Training data bias**: Performance may vary for threats or attack patterns not well-represented in the training data
|
| 195 |
+
- **Context window**: Supports up to 65,536 tokens (64K); training used 4,096 max sequence length but the base model's full context capability is preserved
|
| 196 |
- **No real-time data**: The model does not have access to real-time threat intelligence feeds
|
| 197 |
|
| 198 |
## Citation
|
|
|
|
| 200 |
```bibtex
|
| 201 |
@misc{rhythmai-cybersec-20b,
|
| 202 |
title={RhythmAI Cybersec 20B: A Fine-Tuned Cybersecurity Language Model},
|
| 203 |
+
author={Syed Hasan Iqbal},
|
| 204 |
year={2026},
|
| 205 |
url={https://huggingface.co/SyedCode01/rhythmai-cybersec-20b},
|
| 206 |
note={Fine-tuned from OpenAI GPT-OSS-20B for SOC operations}
|