Add model metadata and improve documentation

README.md

@@ -1,11 +1,21 @@
 ---
 license: mit
+library_name: transformers
+pipeline_tag: text-generation
+base_model: Qwen/Qwen3-8B-Base
+tags:
+- reasoning
+- test-time-compute
+- pacore
+- math
+- code
 ---
+
 # PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning
 
 <div align="center">
 
-[**Read the Paper**](https://github.com/stepfun-ai/PaCoRe/blob/main/pacore_report.pdf) | [**Download Models**](https://huggingface.co/stepfun-ai/PaCoRe-8B) | [**Training Data**](https://huggingface.co/datasets/stepfun-ai/PaCoRe-Train-8k)
+[**Read the Paper**](https://arxiv.org/abs/2601.05593) | [**Download Models**](https://huggingface.co/stepfun-ai/PaCoRe-8B) | [**Training Data**](https://huggingface.co/datasets/stepfun-ai/PaCoRe-Train-8k) | [**GitHub**](https://github.com/stepfun-ai/PaCoRe)
 
 </div>
 
@@ -17,22 +27,22 @@ We introduce **PaCoRe (Parallel Coordinated Reasoning)**, a framework that shift
 
 Trained via large-scale, outcome-based reinforcement learning, PaCoRe masters the **Reasoning Synthesis** capabilities required to reconcile diverse parallel insights. 
 
-The approach yields strong improvements across diverse domains, and notably pushes reasoning beyond frontier systems in mathematics: an 8B model reaches 94.5\% on HMMT 2025, surpassing GPT-5’s 93.2\% by scaling effective TTC to roughly two million tokens.
+The approach yields strong improvements across diverse domains, and notably pushes reasoning beyond frontier systems in mathematics: an 8B model reaches 94.5% on HMMT 2025, surpassing GPT-5’s 93.2% by scaling effective TTC to roughly two million tokens.
 
 We open-source model checkpoints, training data, and the full inference pipeline to accelerate follow-up work!
 
 ------
 
 <p align="center">
-  <img src="figure/teaser_draft_02.png" width="48%" />
-  <img src="figure/before_after_train_lcb_02.png" width="48%" />
+  <img src="https://raw.githubusercontent.com/stepfun-ai/PaCoRe/main/figure/teaser_draft_02.png" width="48%" />
+  <img src="https://raw.githubusercontent.com/stepfun-ai/PaCoRe/main/figure/before_after_train_lcb_02.png" width="48%" />
 </p>
 
-*Figure 1 | Parallel Coordinated Reasoning (PaCoRe) performance.  Left: On HMMT 2025, PaCoRe-8B demonstrates remarkable test-time scaling, yielding steady gains and ultimately surpassing GPT-5. Right: On LiveCodeBench, the RLVR-8B model fails to leverage increased test-time compute, while PaCoRe-8B model effectively unlocks substantial gains as the test-time compute increases.*
+*Figure 1 | Parallel Coordinated Reasoning (PaCoRe) performance. Left: On HMMT 2025, PaCoRe-8B demonstrates remarkable test-time scaling, yielding steady gains and ultimately surpassing GPT-5. Right: On LiveCodeBench, the RLVR-8B model fails to leverage increased test-time compute, while PaCoRe-8B model effectively unlocks substantial gains as the test-time compute increases.*
 
 <p align="center">
-  <img src="figure/train_reward_response_length_1130.png" width="48%" />
-  <img src="figure/benchmark_accuracy_1130.png" width="48%" />
+  <img src="https://raw.githubusercontent.com/stepfun-ai/PaCoRe/main/figure/train_reward_response_length_1130.png" width="48%" />
+  <img src="https://raw.githubusercontent.com/stepfun-ai/PaCoRe/main/figure/benchmark_accuracy_1130.png" width="48%" />
 </p>
 
 *Figure 2 | PaCoRe Training dynamics. Left panels: The Training Reward and Response Length steadily increase, demonstrating the training stability and effectiveness. Right panels: Evaluation on HMMT 2025 and LiveCodeBench (2408-2505). Performance is reported using single round coordinated reasoning in PaCoRe inference setting with $\vec{K} = [16]$.*
@@ -41,7 +51,7 @@ We open-source model checkpoints, training data, and the full inference pipeline
 
 **[2025/12/09]** We are excited to release the **PaCoRe-8B** ecosystem:
 
-*   📝 **In-depth Technical Report:** [**PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning.**](https://github.com/stepfun-ai/PaCoRe/blob/main/pacore_report.pdf)
+*   📝 **In-depth Technical Report:** [**PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning.**](https://arxiv.org/abs/2601.05593)
 *   🤖 **Model:** 
      * [PaCoRe-8B](https://huggingface.co/stepfun-ai/PaCoRe-8B): Our final PaCoRe-trained model checkpoint!
      * [RLVR-8B-0926](https://huggingface.co/stepfun-ai/RLVR-8B-0926): The initial checkpoint of our study, conducted strong reasoning-oriented post-trained on [Qwen3-8B-Base](https://huggingface.co/Qwen/Qwen3-8B-Base).
@@ -56,7 +66,7 @@ We open-source model checkpoints, training data, and the full inference pipeline
   <tr>
     <th class="tg-header"></th>
     <th class="tg-data">HMMT 2025</th>
-    <th class="tg-data">LiveCodeBench</th>
+    <th class="tg-data">LiveCodeBench (2408-2505)</th>
     <th class="tg-data">HLE<sub>text</sub></th>
     <th class="tg-data">MultiChallenge</th>
   </tr>
@@ -130,8 +140,7 @@ We open-source model checkpoints, training data, and the full inference pipeline
 </tbody>
 </table>
 
-*Table 1 | For each benchmark, we report accuracy together with total TTC (in thousands). For *Low*, *Medium*, and *High*, we apply the inference trajectory configuration as $\vec{K}=[4]$, $[16]$, and $[32, 4]$ separately.*
-
+*Table 1 | For each benchmark, we report accuracy together with total TTC (in thousands). For Low, Medium, and High, we apply the inference trajectory configuration as $\vec{K}=[4]$, $[16]$, and $[32, 4]$ separately.*
 
 ### Key Findings
 * **Message Passing Unlocks Scaling.** Without compaction, performance flatlines at the context limit. PaCoRe breaks the memory barrier and lets reasoning scale freely.
@@ -139,52 +148,38 @@ We open-source model checkpoints, training data, and the full inference pipeline
 * **Data as a Force Multiplier.** The PaCoRe corpus provides exceptionally valuable supervision—even baseline models see substantial gains when trained on it.
 
 ## Getting Started 🚀
-### Data
-The data is provided as a `list[dict]`, where each entry represents a training instance:
-*   `conversation`: The original problem/prompt messages.
-*   `responses`: A list of cached generated responses (trajectories). These serve as the **input messages ($M$)** used during PaCoRe training.
-*   `ground_truth`: The verifiable answer used for correctness evaluation.
+### Installation
+First, install the package from the official repository:
+```bash
+pip install -e . 
+```
 
 ### Model Serving
-You can directly use `vllm serve` to serve the model! More inference details of PaCoRe will be handled in Inference Pipeline. 
-
-### Inference Pipeline
-![](/figure/inference_pipeline_teaser_02.png)
-
-*Figure 3 | Inference pipeline of PaCoRe. Each round launches broad parallel exploration, compacts the resulting trajectories into compacted messages, and feeds these messages together with the question forward to coordinate the next round.  Repeating this process $\hat{R}$ times yields multi-million-token effective TTC while respecting fixed context limits, with the final compacted message serving as the system’s answer.*
-
-Inference code coming soon!
+You can directly use `vllm serve` to serve the model:
+```bash
+vllm serve stepfun-ai/PaCoRe-8B
+```
 
+### Inference Example
+Next, you can run our example inference code with PaCoRe-low inference setting:
+```bash
+python playground/example_batch_inference_pacore_low_1210.py
+```
 
 ## 🙏 Acknowledgements
 - This work was supported by computing resources and infrastructure provided by [StepFun](https://www.stepfun.com/) and Tsinghua University.
-- We are deeply grateful to our colleagues for their support:
-  * Inference: Song Yuan, Wuxun Xie, Mingliang Li, Bojun Wang.
-  * Training: Xing Chen, Yuanwei Lu, Changyi Wan, Yu Zhou.
-  * Infra Operations: Shaoliang Pang, Changxin Miao, Xu Zhao, Wei Zhang, Zidong Yang, Junzhe Lin, Yuxiang Yang, Chen Xu, Xin Li, Bin Wang.
-  * Data Management: Xiaoxiao Ren, Zhiguo Huang, and Kang An.
-  * Helpful Discussions: Liang Zhao, Jianjian Sun, Zejia Weng, JingJing Xie.
-- We are grateful for colleagues from StepFun and Tsinghua University for their valuable feedback and contributions.
-- Our work is built on amazing open source models and data; thanks again!
-
-## 🔮 Future Work
-We are just scratching the surface of parallel coordinated reasoning. Our roadmap includes:
-- **Scaling the Extremes**: We plan to apply PaCoRe to stronger foundation models, expanding the task domains, and further scaling up both the breadth (parallel trajectories) and depth (coordination rounds) to tackle challenges currently deemed unsolvable.
-- **Boosting Token Intelligence Density**: While we currently scale by volume, we aim to maximize the utility of every unit of compute spent. This involves enabling more efficient parallel exploration through better organization, cooperation, and division of labor among trajectories.
-- **Emergent Multi-Agent Intelligence**: We are interested in exploring the joint training of both the synthesis policy and the message-passing mechanism, laying minimal yet rich cooperative multi-agent learning environment, offering a valuable playground for studying emergent communication, self-organization, and collective intelligence.
-- **Ouroboros for Pre- and Post-Training**: we intend to investigate the development of advanced synthetic data generation techniques with PaCoRe pipeline to improve both current pretraining and post-training processes.
-
-## Advertisement Time 📣
-We are currently seeking self-motivated engineers and reseachers.
-If you are interested in our project and would like to contribute to the reasoner scale-up all the way to AGI, please feel free to reach out to us at hanqer@stepfun.com
+- We are built on amazing open source models and data; thanks again!
 
 ## 📜 Citation
 
 ```bibtex
 @misc{pacore2025,
-  title={PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning},
-  author={Jingcheng Hu and Yinmin Zhang and Shijie Shang and Xiaobo Yang and Yue Peng and Zhewei Huang and Hebin Zhou and Xin Wu and Jie Cheng and Fanqi Wan and Xiangwen Kong and Chengyuan Yao and Ailin Huang and Hongyu Zhou and Qi Han and Zheng Ge and Daxin Jiang and Xiangyu Zhang and Heung-Yeung Shum},
-  year={2025},
-  url={[https://github.com/stepfun-ai/PaCoRe/blob/main/pacore_report.pdf](https://github.com/stepfun-ai/PaCoRe/blob/main/pacore_report.pdf)},
+      title={PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning}, 
+      author={Jingcheng Hu and Yinmin Zhang and Shijie Shang and Xiaobo Yang and Yue Peng and Zhewei Huang and Hebin Zhou and Xin Wu and Jie Cheng and Fanqi Wan and Xiangwen Kong and Chengyuan Yao and Kaiwen Yan and Ailin Huang and Hongyu Zhou and Qi Han and Zheng Ge and Daxin Jiang and Xiangyu Zhang and Heung-Yeung Shum},
+      year={2026},
+      eprint={2601.05593},
+      archivePrefix={arXiv},
+      primaryClass={cs.LG},
+      url={https://arxiv.org/abs/2601.05593}, 
 }
 ```