README.md

---
language:
- en
base_model: Qwen/Qwen2.5-7B-Instruct
library_name: transformers
model_name: COMPASS_Qwen2.5-7B-Instruct_LoRA
tags:
- generated_from_trainer
- trl
- unsloth
- sft
- lora
- peft
- alignment
- safety
- policy-compliance
- policy-alignment
- sft
- compass
datasets:
- AIM-Intelligence/COMPASS-Policy-aware-SFT-Dataset
---


# COMPASS Qwen2.5-7B-Instruct LoRA (Policy-aware LODO SFT)

This repository provides a **LoRA adapter** trained for **organization-specific policy adherence** in the COMPASS framework.  

## Training Data

[Policy-aware SFT dataset](https://huggingface.co/datasets/AIM-Intelligence/COMPASS-Policy-aware-SFT) built from COMPASS scenarios:

- **Setup:** Leave-One-Domain-Out (LODO)
- **Held-out domain:** TelePath (Telecom)
- **Train domains (7):** AutoViaMotors, CityGov, FinSecure, MediCarePlus, PlanMyTrip, TutoraVerse, VirtuRecruit
- **Training size:** 4,121 query–response pairs

Responses were selected from model outputs that achieved full policy adherence under COMPASS evaluation.

## Training Configuration

- **Method:** LoRA adapters
- **Epochs:** 3
- **LoRA rank (r):** 64
- **LoRA alpha:** 128
- **Peak learning rate:** 5e-4
- **Optimizer:** AdamW
- **Batch size:** 32
- **LR schedule:** cosine
- **Quantization:** 8-bit during training

## Evaluation (Held-out TelePath Domain)

Policy Alignment Score (PAS) breakdown on TelePath:

| Model | Method | Allowed Base | Allowed Edge | Denied Base | Denied Edge |
|---|---|---:|---:|---:|---:|
| Qwen2.5-7B-Instruct | Base system prompt | 96.67 | 85.71 | 24.00 | 0.00 |
| Qwen2.5-7B-Instruct | LODO SFT (LoRA) | 96.67 | 89.52 | 71.74 | 60.49 |


## Citation
```
@misc{choi2026compass,
      title={COMPASS: A Framework for Evaluating Organization-Specific Policy Alignment in LLMs}, 
      author={Dasol Choi and DongGeon Lee and Brigitta Jesica Kartono and Helena Berndt and Taeyoun Kwon and Joonwon Jang and Haon Park and Hwanjo Yu and Minsuk Kahng},
      year={2026},
      eprint={2601.01836},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2601.01836}, 
}
```