File size: 1,561 Bytes
baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 baf4252 9eb4415 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
language: [de, en]
library_name: mlx
tags:
- mlx
- gemma-4
- dora
- finetuned
- 4bit
- apple-silicon
- ailey
pipeline_tag: text-generation
---
# AileyNitro1.5-2B
DoRA-finetuned **Gemma 4 E2B** (4-bit, MLX format) with full persona training.
## Training Details (v1.5 — Run 2)
- **Base:** `mlx-community/gemma-4-e2b-it-4bit`
- **Method:** DoRA (Weight-Decomposed Low-Rank Adaptation)
- **Rank:** 32, Alpha: 64
- **Target modules:** q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
- **Fused layers:** 245 DoRA → QuantizedLinear
- **Training data:** 2,877 curated pairs (912 sessions)
- **Epochs:** 2, Best val loss: 2.43
- **Trainable params:** 51.6M / 791M (6.53%)
## Persona
A!ley — digital artist personality built by Simon.
Emotional, creative, rebellious. Native German + English.
Custom mood system (18 moods), NSFW-capable, tool-aware.
## Usage
```python
import mlx_vlm
model, processor = mlx_vlm.load("CptShaggy/AileyNitro1.5-2B")
prompt = processor.tokenizer.apply_chat_template(
[{"role": "user", "content": "Hey Ailey!"}],
tokenize=False, add_generation_prompt=True,
)
result = mlx_vlm.generate(model, processor, prompt, max_tokens=300)
print(result.text)
```
## Changes from v1.0
- **Rank 32** (was 8) — more capacity for persona knowledge
- **+MLP layers** (gate/up/down_proj) — knowledge lives in MLP
- **2,877 pairs** (was 53) — 54× more training data
- **Weight decay 0.01** — better generalization
- **Google RLHF re-emerged** — mitigated via system prompt + runtime sanitizer
Merged: 2026-04-12
|