idobrovolskyi commited on
Commit
0a565fc
·
verified ·
1 Parent(s): c9b3738

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +76 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - cybersecurity
5
+ - document-classification
6
+ - gguf
7
+ - ollama
8
+ - qwen
9
+ - lora
10
+ base_model: Qwen/Qwen3.5-27B
11
+ ---
12
+
13
+ # TorchSight Beam q8_0
14
+
15
+ Cybersecurity document classifier. LoRA fine-tune of Qwen 3.5 27B, quantized to q8_0. 28GB GGUF.
16
+
17
+ Higher quality weights (92.7% accuracy). For 48GB+ GPU or 64GB Mac.
18
+
19
+ ## Benchmark Results (1000 samples)
20
+
21
+ | Model | Category Acc | Subcategory Acc |
22
+ |---|---|---|
23
+ | **Beam q4_K_M** | **95.1%** | 48.5% |
24
+ | Beam f16 | 93.0% | 51.3% |
25
+ | Beam q8_0 | 92.7% | 51.3% |
26
+ | Claude Opus 4 | 79.9% | 22.5% |
27
+ | Gemini 2.5 Pro | 75.4% | 21.0% |
28
+ | Qwen 3.5 27B (no fine-tune) | 43.3% | 4.3% |
29
+
30
+ ## Usage with Ollama
31
+
32
+ ```bash
33
+ ollama pull torchsight/beam:q8_0
34
+ ```
35
+
36
+ Or with the GGUF file:
37
+
38
+ ```
39
+ # Modelfile
40
+ FROM ./beam-1.0-q8_0.gguf
41
+
42
+ TEMPLATE "{{ .Prompt }}"
43
+ ```
44
+
45
+ ## Output Format
46
+
47
+ ```json
48
+ [
49
+ {
50
+ "category": "credentials",
51
+ "subcategory": "credentials.api_key",
52
+ "severity": "critical",
53
+ "explanation": "AWS access key found: AKIA****VIW..."
54
+ }
55
+ ]
56
+ ```
57
+
58
+ Categories: `pii`, `credentials`, `financial`, `medical`, `confidential`, `malicious`, `safe`
59
+
60
+ ## Training
61
+
62
+ - Base: Qwen 3.5 27B (dense)
63
+ - Method: LoRA (r=128, alpha=256)
64
+ - Data: 74K balanced samples from 18+ sources
65
+ - Epochs: 5
66
+ - GPU: H100 80GB PCIe
67
+
68
+ ## Links
69
+
70
+ - [Benchmark Dataset](https://huggingface.co/datasets/torchsight/cybersecurity-classification-benchmark)
71
+ - [Training Data](https://huggingface.co/datasets/torchsight/beam-training-data)
72
+ - [GitHub](https://github.com/IvanDobrovolsky/torchsight)
73
+
74
+ ## License
75
+
76
+ Apache 2.0