Improve model card: Add tags, paper link, code, and usage example

README.md

@@ -1,8 +1,90 @@
 ---
+base_model:
+- Qwen/Qwen2.5-7B-Instruct
 license: other
 license_name: license
 license_link: LICENSE
-base_model:
-- Qwen/Qwen2.5-7B-Instruct
+pipeline_tag: text-generation
+library_name: transformers
+tags:
+- reinforcement-learning
+- empathetic-agent
+- dialogue
+- llm
+- qwen
+- instruct
 ---
-https://www.arxiv.org/abs/2507.03112
+
+# RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents
+
+This repository hosts the `Qwen2.5-7B-Instruct` model fine-tuned using **RLVER**, a novel reinforcement learning framework for cultivating higher-order empathetic abilities in Large Language Models (LLMs).
+
+**RLVER** is the first end-to-end reinforcement learning framework that leverages verifiable emotion rewards from simulated users to guide the LLM's learning. By engaging self-consistent affective simulated users in dialogue rollouts that produce deterministic emotion scores, RLVER significantly boosts emotional intelligence while largely preserving other cognitive competencies, as demonstrated by an increase in Sentient-Benchmark scores from 13.3 to 79.2.
+
+**[\ud83d\udcda Paper](https://huggingface.co/papers/2507.03112)** | **[\ud83d\udcbb Code](https://github.com/Tencent/digitalhuman/tree/main/RLVER)**
+
+<p align="center"><img width="90%" src="https://github.com/Tencent/digitalhuman/raw/main/RLVER/code/figs/framework.png" alt="RLVER Framework Overview" /></p>
+<p align="center"><em>The overview of RLVER. This work presents the first end-to-end reinforcement-learning framework that equips an LLM with human-level empathetic skills by optimizing against verifiable emotion rewards.</em></p>
+
+<p align="center"><img width="90%" src="https://github.com/Tencent/digitalhuman/raw/main/RLVER/code/figs/main_result.png" alt="RLVER Main Result" /></p>
+<p align="center"><em>The main result of RLVER, showcasing the improvement in Sentient-Benchmark score.</em></p>
+
+## Usage
+
+This model can be easily loaded and used for text generation with the `transformers` library. The model uses a chat template, so it's recommended to use `apply_chat_template` for optimal performance in conversational settings.
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+model_id = "RLVER/RLVER-Qwen2.5-7B-Instruct" # Replace with actual repo name if different
+
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(
+    model_id,
+    torch_dtype=torch.bfloat16, # Or torch.float16 depending on your hardware/preference
+    device_map="auto"
+)
+
+# Example conversation following the Qwen chat template
+messages = [
+    {"role": "system", "content": "You are a helpful and empathetic assistant."},
+    {"role": "user", "content": "I'm feeling a bit overwhelmed with work lately. Any advice?"},
+]
+
+# Apply the chat template and tokenize
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=True
+)
+
+model_inputs = tokenizer(text, return_tensors="pt").to(model.device)
+
+# Generate a response
+generated_ids = model.generate(
+    model_inputs.input_ids,
+    max_new_tokens=512,
+    do_sample=True,
+    temperature=0.7,
+    top_p=0.9,
+    eos_token_id=tokenizer.eos_token_id
+)
+
+response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
+print(response)
+```
+
+## Citation
+
+If you find this work useful for your research, please consider citing the paper:
+
+```bibtex
+@article{zhou2024learning,
+  title={RLVER: Reinforcement Learning with Verifiable Emotion Rewards for Empathetic Agents},
+  author={Zhou, Yulin and Li, Yiran and Wang, Ruipeng and Feng, Yuanhui and Chen, Jingsheng and Zhu, Haoran and Lu, Ming and Lv, Qingwei and Liu, Hong and Li, Weichao and Wu, Xing and Chen, Wenliang},
+  journal={arXiv preprint arXiv:2507.03112},
+  year={2025},
+  url={https://arxiv.org/abs/2507.03112}
+}
+```