Instructions to use coldcurrent/encinitas-gemma4-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use coldcurrent/encinitas-gemma4-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-4-26B-A4B-it") model = PeftModel.from_pretrained(base_model, "coldcurrent/encinitas-gemma4-lora") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model: google/gemma-4-26B-A4B-it
|
| 4 |
+
tags:
|
| 5 |
+
- lora
|
| 6 |
+
- gemma4
|
| 7 |
+
- moe
|
| 8 |
+
- peft
|
| 9 |
+
- encinitas
|
| 10 |
+
- cybersecurity
|
| 11 |
+
- virgil
|
| 12 |
+
library_name: peft
|
| 13 |
+
pipeline_tag: text-generation
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# encinitas-gemma4-lora
|
| 17 |
+
|
| 18 |
+
LoRA adapter for **encinitas** — a VIRGIL-style blue-team fine-tune on [Gemma 4 26B A4B](https://huggingface.co/google/gemma-4-26B-A4B-it).
|
| 19 |
+
|
| 20 |
+
Trained for endpoint security investigation: MITRE ATT&CK mapping, Sigma rule analysis, malware behavior reasoning, and structured defender recommendations in the `<reasoning>...</reasoning><answer>{JSON}</answer>` contract.
|
| 21 |
+
|
| 22 |
+
Uses Fireworks `fused_peft_3d_v1` MoE expert layout. **Stock PEFT cannot load this adapter alone** — use the VIRGIL inference scripts that merge fused expert LoRA:
|
| 23 |
+
|
| 24 |
+
https://github.com/artk-code/virgil/tree/main/inference/encinitas
|
| 25 |
+
|
| 26 |
+
## Quick start
|
| 27 |
+
|
| 28 |
+
```bash
|
| 29 |
+
git clone https://github.com/artk-code/virgil.git
|
| 30 |
+
cd virgil/inference/encinitas
|
| 31 |
+
cp encinitas.env.example encinitas.env # add HF_TOKEN locally — never commit
|
| 32 |
+
# Accept Gemma 4 license: https://huggingface.co/google/gemma-4-26B-A4B-it
|
| 33 |
+
|
| 34 |
+
bash fix_encinitas_gfx1151_torch.sh # AMD Strix Halo / gfx1151
|
| 35 |
+
# bash setup_cuda_venv.sh # NVIDIA 48GB+
|
| 36 |
+
|
| 37 |
+
./run_encinitas_local.sh "Your prompt"
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
## Requirements
|
| 41 |
+
|
| 42 |
+
- Base model: `google/gemma-4-26B-A4B-it` (~49 GB, gated)
|
| 43 |
+
- 48 GiB+ VRAM (fp16); Strix Halo (~96 GiB unified) tested on ROCm
|
| 44 |
+
- Hugging Face token with Gemma 4 license accepted
|
| 45 |
+
|
| 46 |
+
## Evaluation (summary)
|
| 47 |
+
|
| 48 |
+
Public OOD cyber eval (Meta CyberSecEval-inspired prompts). Full methodology:
|
| 49 |
+
https://www.artkaiser.net/blog/encinitas-cheaper-better-cyber-inference
|
| 50 |
+
|
| 51 |
+
| Model | TTP % | Actionable % | Format (0-4 avg) |
|
| 52 |
+
|-------|-------|--------------|------------------|
|
| 53 |
+
| Encinitas LoRA | 100% | 50% | 2.0 |
|
| 54 |
+
| Gemma4-26b-a4b-it (base) | 100% | 67% | 3.0 |
|
| 55 |
+
| Kimi k2p7-code | 100% | 100% | 1.3 |
|
| 56 |
+
|
| 57 |
+
encinitas excels at **concise, parseable, contract-aligned** outputs for SOC and agent workflows.
|
| 58 |
+
|
| 59 |
+
Training context (VIRGIL corpus): https://www.artkaiser.net/blog/custom-cybersecurity-models-fireworks
|
| 60 |
+
|
| 61 |
+
## License
|
| 62 |
+
|
| 63 |
+
- Scripts in [artk-code/virgil](https://github.com/artk-code/virgil): MIT
|
| 64 |
+
- Adapter weights: MIT
|
| 65 |
+
- Base Gemma 4: Google Gemma license (accept on Hugging Face)
|