coldcurrent commited on
Commit
6c83861
·
verified ·
1 Parent(s): 4232857

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +65 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: google/gemma-4-26B-A4B-it
4
+ tags:
5
+ - lora
6
+ - gemma4
7
+ - moe
8
+ - peft
9
+ - encinitas
10
+ - cybersecurity
11
+ - virgil
12
+ library_name: peft
13
+ pipeline_tag: text-generation
14
+ ---
15
+
16
+ # encinitas-gemma4-lora
17
+
18
+ LoRA adapter for **encinitas** — a VIRGIL-style blue-team fine-tune on [Gemma 4 26B A4B](https://huggingface.co/google/gemma-4-26B-A4B-it).
19
+
20
+ Trained for endpoint security investigation: MITRE ATT&CK mapping, Sigma rule analysis, malware behavior reasoning, and structured defender recommendations in the `<reasoning>...</reasoning><answer>{JSON}</answer>` contract.
21
+
22
+ Uses Fireworks `fused_peft_3d_v1` MoE expert layout. **Stock PEFT cannot load this adapter alone** — use the VIRGIL inference scripts that merge fused expert LoRA:
23
+
24
+ https://github.com/artk-code/virgil/tree/main/inference/encinitas
25
+
26
+ ## Quick start
27
+
28
+ ```bash
29
+ git clone https://github.com/artk-code/virgil.git
30
+ cd virgil/inference/encinitas
31
+ cp encinitas.env.example encinitas.env # add HF_TOKEN locally — never commit
32
+ # Accept Gemma 4 license: https://huggingface.co/google/gemma-4-26B-A4B-it
33
+
34
+ bash fix_encinitas_gfx1151_torch.sh # AMD Strix Halo / gfx1151
35
+ # bash setup_cuda_venv.sh # NVIDIA 48GB+
36
+
37
+ ./run_encinitas_local.sh "Your prompt"
38
+ ```
39
+
40
+ ## Requirements
41
+
42
+ - Base model: `google/gemma-4-26B-A4B-it` (~49 GB, gated)
43
+ - 48 GiB+ VRAM (fp16); Strix Halo (~96 GiB unified) tested on ROCm
44
+ - Hugging Face token with Gemma 4 license accepted
45
+
46
+ ## Evaluation (summary)
47
+
48
+ Public OOD cyber eval (Meta CyberSecEval-inspired prompts). Full methodology:
49
+ https://www.artkaiser.net/blog/encinitas-cheaper-better-cyber-inference
50
+
51
+ | Model | TTP % | Actionable % | Format (0-4 avg) |
52
+ |-------|-------|--------------|------------------|
53
+ | Encinitas LoRA | 100% | 50% | 2.0 |
54
+ | Gemma4-26b-a4b-it (base) | 100% | 67% | 3.0 |
55
+ | Kimi k2p7-code | 100% | 100% | 1.3 |
56
+
57
+ encinitas excels at **concise, parseable, contract-aligned** outputs for SOC and agent workflows.
58
+
59
+ Training context (VIRGIL corpus): https://www.artkaiser.net/blog/custom-cybersecurity-models-fireworks
60
+
61
+ ## License
62
+
63
+ - Scripts in [artk-code/virgil](https://github.com/artk-code/virgil): MIT
64
+ - Adapter weights: MIT
65
+ - Base Gemma 4: Google Gemma license (accept on Hugging Face)