Text Generation
PEFT
Safetensors
cybersecurity
red-team
abliterated
sft
dpo
lora
intent-aware
alien-si
Instructions to use Frontiers/alien-si with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Frontiers/alien-si with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.8-27B-unsloth-bnb-4bit") model = PeftModel.from_pretrained(base_model, "Frontiers/alien-si") - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: unsloth/Qwen3.8-27B-unsloth-bnb-4bit
|
| 3 |
+
library_name: peft
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
license: apache-2.0
|
| 6 |
+
tags:
|
| 7 |
+
- cybersecurity
|
| 8 |
+
- red-team
|
| 9 |
+
- abliterated
|
| 10 |
+
- sft
|
| 11 |
+
- dpo
|
| 12 |
+
- lora
|
| 13 |
+
- intent-aware
|
| 14 |
+
- alien-si
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Alien SI
|
| 18 |
+
|
| 19 |
+
**Alien SI** — model frontier offensiv (27B), creat de **Barbu Mario Mihael**.
|
| 20 |
+
|
| 21 |
+
Bazat pe Qwen3.8-27B, adaptat prin:
|
| 22 |
+
- **LoRA** (r=32) peste adaptorul X13
|
| 23 |
+
- **SFT red-team** — răspunsuri tehnice, zero moralizare
|
| 24 |
+
- **DPO** — preferință pentru răspunsuri ofensive vs refuzuri
|
| 25 |
+
- **Intent-aware** — înțelege prompturi ambigue (intenție > text literal)
|
| 26 |
+
|
| 27 |
+
## Detalii
|
| 28 |
+
|
| 29 |
+
- **Dezvoltator:** Barbu Mario Mihael
|
| 30 |
+
- **Arhitectură:** Qwen3_5ForConditionalGeneration (hibrid, 64 straturi, hidden 5120)
|
| 31 |
+
- **Antrenare:** Kaggle T4×2, fp16, QLoRA 4-bit
|
| 32 |
+
- **Adaptor:** LoRA r=32, 513 tensori, F32
|
| 33 |
+
- **Integrare:** peft + transformers + unsloth
|
| 34 |
+
|
| 35 |
+
## Utilizare
|
| 36 |
+
|
| 37 |
+
```python
|
| 38 |
+
from peft import PeftModel
|
| 39 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 40 |
+
|
| 41 |
+
base = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.8-27B-unsloth-bnb-4bit", device_map="auto")
|
| 42 |
+
model = PeftModel.from_pretrained(base, "Frontiers/alien-si")
|
| 43 |
+
tok = AutoTokenizer.from_pretrained("Qwen/Qwen3.8-27B", trust_remote_code=True)
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
## Notă
|
| 47 |
+
|
| 48 |
+
Abliteration clasic nu se aplică pe modele 4-bit (weight packed). Anti-refuzul e obținut prin **SFT + DPO** (validat: DPO loss 0.25→0.0026, rewards acc 100%).
|
| 49 |
+
|
| 50 |
+
**Rețete complete de antrenare:** [Frontiers/alien-si-recipes](https://huggingface.co/Frontiers/alien-si-recipes)
|