| --- |
| license: llama3.1 |
| base_model: meta-llama/Llama-3.1-8B-Instruct |
| tags: |
| - fine-tuned |
| - lora |
| - sipa-os |
| - protocol0 |
| --- |
| |
| # protocol0-llama-3.1-8b-v5 |
|
|
| Fine-tuned `meta-llama/Llama-3.1-8B-Instruct` on the **protocol0** behavioral compliance |
| dataset (v5, 2,349 examples), part of the SIPA OS AI experiment series |
| (https://github.com/soulinpsyabstract/sipa-os-governance/tree/main/AI_EXPERIMENTS). |
| |
| The dataset trains the model toward a specific set of behavioral constraints — stopping |
| under ambiguity, not fabricating unverifiable claims, no unsolicited opinions, single-action |
| responses, conciseness — derived from an internal governance protocol (Protocol 0 / CORE LAW), |
| not a general-purpose instruction-following upgrade. |
| |
| ## Training |
| |
| - Base: `meta-llama/Llama-3.1-8B-Instruct` |
| - Method: LoRA (r=16, alpha=32, dropout=0.05, target modules q/k/v/o_proj), full merge published here |
| - Platform: Together AI managed fine-tuning |
| - Dataset: 2,349 examples, protocol0_sft_v3 system prompt |
| (https://github.com/soulinpsyabstract/sipa-os-governance/blob/main/AI_EXPERIMENTS/DATASETS/protocol0_sft_v3_full.jsonl) |
|
|
| ## Status |
|
|
| Trained and weights secured. **Not yet behaviorally benchmarked** against the base model — |
| this repo documents both positive and negative/inconclusive results for every experiment in |
| this series (see the AI_EXPERIMENTS folder above), and this model's write-up is pending. |
| Do not treat this as a validated result until a corresponding EXP write-up is published. |
| |
| ## License |
| |
| Distributed under the Llama 3.1 Community License, per the base model's terms. |
| |
