license: cc-by-nc-4.0
library_name: transformers
pipeline_tag: text-classification
base_model: meta-llama/Llama-3.1-8B
MAHALO - Engagement Process Reward Model (PRM)
This repository contains the Engagement Process Reward Model (PRM) introduced in the paper Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards.
This model is a fine-tuned version of Llama-3.1-8B using the LlamaForSequenceClassification architecture. It is part of the MAHALO (Multi-Action-Head ALignment with PRM-guided DecOding) framework, designed to provide step-level reward signals for student engagement in multi-turn AI tutoring dialogues (Socratic Mind domain).
Resources
- Paper: Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards
- Repository: pearls-lab/multiobj-align
Model Description
The MAHALO framework standardizes PRM training across verifiable and non-verifiable settings for step-level supervision. This specific model serves as a Process Reward Model (PRM) to evaluate and guide the "engagement" objective, helping to align the model with human preferences in complex interactive scenarios.
Citation
@article{shen2025simultaneous,
title={Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards},
author={Shen, Yiran and Xia, Yu and Chang, Jonathan and Ammanabrolu, Prithviraj},
journal={arXiv preprint arXiv:2510.01167},
year={2025},
url={https://arxiv.org/abs/2510.01167}
}