README.md

---
license: llama3.1
base_model: meta-llama/Llama-3.1-8B-Instruct
tags:
  - fine-tuned
  - lora
  - sipa-os
  - protocol0
---

# protocol0-llama-3.1-8b-v5

Fine-tuned `meta-llama/Llama-3.1-8B-Instruct` on the **protocol0** behavioral compliance
dataset (v5, 2,349 examples), part of the SIPA OS AI experiment series
(https://github.com/soulinpsyabstract/sipa-os-governance/tree/main/AI_EXPERIMENTS).

The dataset trains the model toward a specific set of behavioral constraints — stopping
under ambiguity, not fabricating unverifiable claims, no unsolicited opinions, single-action
responses, conciseness — derived from an internal governance protocol (Protocol 0 / CORE LAW),
not a general-purpose instruction-following upgrade.

## Training

- Base: `meta-llama/Llama-3.1-8B-Instruct`
- Method: LoRA (r=16, alpha=32, dropout=0.05, target modules q/k/v/o_proj), full merge published here
- Platform: Together AI managed fine-tuning
- Dataset: 2,349 examples, protocol0_sft_v3 system prompt
  (https://github.com/soulinpsyabstract/sipa-os-governance/blob/main/AI_EXPERIMENTS/DATASETS/protocol0_sft_v3_full.jsonl)

## Status

Trained and weights secured. **Not yet behaviorally benchmarked** against the base model —
this repo documents both positive and negative/inconclusive results for every experiment in
this series (see the AI_EXPERIMENTS folder above), and this model's write-up is pending.
Do not treat this as a validated result until a corresponding EXP write-up is published.

## License

Distributed under the Llama 3.1 Community License, per the base model's terms.