File size: 6,089 Bytes
1703334 0125fb6 3c47d24 0125fb6 3c47d24 365a03f 3c47d24 0125fb6 2df835e 0125fb6 3c47d24 0125fb6 3c47d24 6c60a98 0125fb6 3c47d24 0125fb6 6c60a98 0125fb6 6c60a98 0125fb6 3c47d24 0125fb6 6c60a98 0125fb6 6c60a98 0125fb6 6c60a98 3c47d24 6c60a98 0125fb6 3c47d24 0125fb6 6c60a98 0125fb6 5c398b8 0125fb6 5c398b8 0125fb6 5c398b8 0125fb6 3c47d24 0125fb6 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 |
---
license: apache-2.0
language:
- en
base_model:
- Qwen/Qwen2.5-1.5B-Instruct
tags:
- recommendation
- generative
- generative recommendation
- recommendation-system
- llm
- large-language-model
- recommender-system
---
<div align="center">
# 🌟 MiniOneRec · Generative Recommender Checkpoints
<img src="./assets/logo.png" width="500em" ></img>
**An Open-Source Framework for
Scaling Generative Recommendation**
<a href="https://arxiv.org/abs/2510.24431"><img src="https://img.shields.io/static/v1?label=arXiv&message=Paper&color=red"></a>
</div>
**MiniOneRec** is the first fully open-source **generative recommendation** framework, which provides an end-to-end workflow spanning **SID construction**, **supervised fine-tuning (SFT)**, and recommendation-oriented **reinforcement learning (RL)**.
These checkpoints accompany the paper:
> **MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation**
> <a href="https://arxiv.org/abs/2510.24431">📄 Technical Report</a> | <a href="https://github.com/AkaliKong/MiniOneRec">📦 Github</a>|<a href="https://modelscope.cn/models/k925238839/MiniOneRec">🤖 Modelscope</a>
---
## 🗺️ Table of Contents
1. Repository Contents
2. Key Techniques
3. Evaluation
4. Acknowledgements
5. Institutions
6. Citation
---
## 1️⃣ Repository Contents <a name="repo"></a>
| File / Directory | Description |
| -------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
| `Amazon/` | **Pre-processed Amazon-2018 dataset** ─ contains both *Industrial* and *Office* splits |
| `Industrial_ckpt/` | **MiniOneRec full-training checkpoint** for the *Industrial* split (base model: Qwen2.5-1.5B-Instruct) |
| `Office_ckpt/` | **MiniOneRec full-training checkpoint** for the *Office* split (base model: Qwen2.5-1.5B-Instruct) |
## 2️⃣ Key Techniques
<div align="center">
<img src="./assets/minionerec_framework.png" width=100% ></img>
</div>
- **SID Construction: MiniOneRec begins by transforming every product into a compact, semantically meaningful token.** It concatenates an item’s title and description, feeds this sentence through a frozen text encoder, and then quantises the resulting embedding with a three-level RQ-VAE.
- **SFT: With all items rewritten as SIDs, the model is first trained in a supervised fashion.** It views the chronologically ordered user history as a token sequence and learns, via next-token prediction, to generate the SID of the next product the user is likely to consume. Crucially, this stage is co-trained with a set of language-alignment objectives that map back and forth between natural language and SID space, allowing the recommender to inherit the world knowledge embedded in large language models while grounding that knowledge in discrete item codes.
- **Recommendation-Oriented RL: After SFT, MiniOneRec is further polished with a recommendation-oriented RL phase based on GRPO.** Multiple candidate recommendations are generated for each prompt, their rewards are normalised within the group to stabilise gradients, and a KL penalty keeps the updated policy close to its reference. Because the action space is a closed list of item SIDs, the system switches to constrained beam search, which guarantees that every beam is unique and valid, greatly improving sampling efficiency and diversity. The reward signal itself blends a binary correctness term with a rank-aware component that penalises high-probability yet incorrect items more heavily, and can be augmented with collaborative-filtering scores. Together, this pipeline enables MiniOneRec to couple dense linguistic knowledge, achieving a high-performance, lightweight generative recommendation system.
---
## 3️⃣ Evaluation
<div align="center">
<img src="./assets/minionerec_main_result.png" width=100% ></img>
</div>
---
## 4️⃣ Acknowledgements
This repository reuses or adapts portions of code from the following open-source projects. We gratefully acknowledge their authors and contributors:
- [ReRe](https://github.com/sober-clever/ReRe)
- [LC-Rec](https://github.com/zhengbw0324/LC-Rec)
---
## 5️⃣ Institutions <!-- omit in toc -->
This project is developed by the following institutions:
- <img src="assets/lds.png" width="28px"> [LDS](https://data-science.ustc.edu.cn/_upload/tpl/15/04/5380/template5380/index.html)
- <img src="assets/alphalab.jpg" width="28px"> [AlphaLab](https://alphalab-ustc.github.io/index.html)
- <img src="assets/next.jpg" width="28px"> [NExT](https://www.nextcenter.org/)
---
## 6️⃣ Citation
If you find our code/paper/model helpful, please consider citing our papers 📝 and staring us ⭐️！
```bib
@misc{MiniOneRec,
title={MiniOneRec: An Open-Source Framework for Scaling Generative Recommendation},
author={Xiaoyu Kong and Leheng Sheng and Junfei Tan and Yuxin Chen and Jiancan Wu and An Zhang and Xiang Wang and Xiangnan He},
year={2025},
eprint={2510.24431},
archivePrefix={arXiv},
primaryClass={cs.IR},
}
@article{ReRe,
title={Reinforced Preference Optimization for Recommendation},
author={Junfei Tan and Yuxin Chen and An Zhang and Junguang Jiang and Bin Liu and Ziru Xu and Han Zhu and Jian Xu and Bo Zheng and Xiang Wang},
journal={arXiv preprint arXiv:2510.12211},
year={2025},
}
@inproceedings{RecZero,
title={Think before Recommendation: Autonomous Reasoning-enhanced Recommender},
author={Xiaoyu Kong and Junguang Jiang and Bin Liu and Ziru Xu and Han Zhu and Jian Xu and Bo Zheng and Jiancan Wu and Xiang Wang},
year={2025},
booktitle={NeurIPS},
}
```
|