Improve model card: add paper link, metadata, and description

README.md

@@ -1,57 +1,57 @@
 ---
+base_model: Qwen/Qwen3-VL-8B-Instruct
 library_name: transformers
 license: other
-base_model: Qwen/Qwen3-VL-8B-Instruct
+pipeline_tag: image-text-to-text
 tags:
 - llama-factory
-- full
+- reward-model
+- image-generation
+- reinforcement-learning
 - generated_from_trainer
 model-index:
-- name: gen_reward_sft
+- name: FIRM-Gen-8B (gen_reward_sft)
   results: []
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-# gen_reward_sft
+# FIRM-Gen-8B (gen_reward_sft)
 
-This model is a fine-tuned version of [Qwen/Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) on the gen_reward_sft dataset.
-It achieves the following results on the evaluation set:
-- Loss: 0.5180
+This model is a fine-tuned version of [Qwen/Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) and serves as a robust reward model (critic) for text-to-image generation. It was introduced as part of the **FIRM (Faithful Image Reward Modeling)** framework in the paper "[Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation](https://huggingface.co/papers/2603.12247)".
 
-## Model description
+- **Paper:** [Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation](https://huggingface.co/papers/2603.12247)
+- **Project Page:** [firm-reward.github.io](https://firm-reward.github.io/)
+- **Repository:** [VisionXLab/FIRM-Reward](https://github.com/VisionXLab/FIRM-Reward)
 
-More information needed
+## Model Description
 
-## Intended uses & limitations
+FIRM-Gen-8B is specifically trained on the **FIRM-Gen-293K** dataset to provide accurate and reliable guidance for faithful image generation. It addresses the common issue of reward hacking and hallucinations in Multimodal Large Language Models (MLLMs) by using a "plan-then-score" pipeline to evaluate how well a generated image follows complex instructions. 
 
-More information needed
+Within a Reinforcement Learning (RL) pipeline, this model acts as the critic, assigning scores that guide the optimization of generative models (like Stable Diffusion 3.5 or FLUX) toward better instruction adherence and visual fidelity.
 
-## Training and evaluation data
+## Intended Uses & Limitations
 
-More information needed
+This model is intended to be used as a reward signal in RL pipelines or as an evaluation metric for text-to-image alignment. It is compatible with the `transformers` library and can be deployed using the reward server scripts found in the official repository.
 
-## Training procedure
+## Training Procedure
 
-### Training hyperparameters
+### Training Hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 1e-05
-- train_batch_size: 5
-- eval_batch_size: 2
-- seed: 42
-- distributed_type: multi-GPU
-- num_devices: 8
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 80
-- total_eval_batch_size: 16
-- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_ratio: 0.1
-- num_epochs: 1.0
-
-### Training results
+- **learning_rate:** 1e-05
+- **train_batch_size:** 5
+- **eval_batch_size:** 2
+- **seed:** 42
+- **distributed_type:** multi-GPU
+- **num_devices:** 8
+- **gradient_accumulation_steps:** 2
+- **total_train_batch_size:** 80
+- **total_eval_batch_size:** 16
+- **optimizer:** AdamW
+- **lr_scheduler_type:** cosine
+- **lr_scheduler_warmup_ratio:** 0.1
+- **num_epochs:** 1.0
+
+### Training Results
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
@@ -63,10 +63,15 @@ The following hyperparameters were used during training:
 | 0.5155        | 0.8279 | 3000 | 0.5207          |
 | 0.5106        | 0.9659 | 3500 | 0.5181          |
 
+## Citation
 
-### Framework versions
+If you find this model useful, please cite:
 
-- Transformers 4.57.3
-- Pytorch 2.7.1+cu128
-- Datasets 4.0.0
-- Tokenizers 0.22.2
+```bibtex
+@article{zhao2025trust,
+  title={Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation},
+  author={Zhao, Xiangyu and Zhang, Peiyuan and Lin, Junming and Liang, Tianhao and Duan, Yuchen and Ding, Shengyuan and Tian, Changyao and Zang, Yuhang and Yan, Junchi and Yang, Xue},
+  journal={arXiv preprint arXiv:2603.12247},
+  year={2025}
+}
+```