Text Classification
Transformers
Safetensors
llama

Add model card for Engagement Process Reward Model

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: transformers
4
+ pipeline_tag: text-classification
5
+ base_model: meta-llama/Llama-3.1-8B
6
+ ---
7
+
8
+ # MAHALO - Engagement Process Reward Model (PRM)
9
+
10
+ This repository contains the Engagement Process Reward Model (PRM) introduced in the paper [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://huggingface.co/papers/2510.01167).
11
+
12
+ This model is a fine-tuned version of [Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) using the `LlamaForSequenceClassification` architecture. It is part of the **MAHALO** (Multi-Action-Head ALignment with PRM-guided DecOding) framework, designed to provide step-level reward signals for student engagement in multi-turn AI tutoring dialogues (Socratic Mind domain).
13
+
14
+ ## Resources
15
+
16
+ - **Paper:** [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://huggingface.co/papers/2510.01167)
17
+ - **Repository:** [pearls-lab/multiobj-align](https://github.com/pearls-lab/multiobj-align)
18
+
19
+ ## Model Description
20
+
21
+ The MAHALO framework standardizes PRM training across verifiable and non-verifiable settings for step-level supervision. This specific model serves as a Process Reward Model (PRM) to evaluate and guide the "engagement" objective, helping to align the model with human preferences in complex interactive scenarios.
22
+
23
+ ## Citation
24
+
25
+ ```bibtex
26
+ @article{shen2025simultaneous,
27
+ title={Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards},
28
+ author={Shen, Yiran and Xia, Yu and Chang, Jonathan and Ammanabrolu, Prithviraj},
29
+ journal={arXiv preprint arXiv:2510.01167},
30
+ year={2025},
31
+ url={https://arxiv.org/abs/2510.01167}
32
+ }
33
+ ```