--- license: apache-2.0 language: - en datasets: - ai9stars/Cheers-Training-Data ---
# ***Cheers: Decoupling Patch Details from Semantic Representations Enables Unified Multimodal Comprehension and Generation*** Yichen Zhang1*, [Da Peng](https://pengda02.github.io/)2*, [Zonghao Guo](https://scholar.google.com/citations?user=h1I6LJcAAAAJ&hl=zh-CN)1†, Zijian Zhang3, Xuesong Yang3, Tong Sun3, Shichu Sun3, Yidan Zhang3, Yanghao Li1, Haiyan Zhao1, Wang Xu1, Qi Shi1, Yangang Sun1, Chi Chen1, Shuo Wang1, Yukun Yan1, Xu Han1, Qiang Ma1, [Wei Ke](https://scholar.google.com/citations?hl=en&user=BENt-uEAAAAJ)2, Liang Wang3, Zhiyuan Liu1, Maosong Sun1 1Tsinghua University, 2Xi'an Jiaotong University, 3University of Chinese Academy of Sciences \* Equal contribution † Corresponding author ## 🌟 What is ***Cheers***? A recent cutting-edge topic in multimodal modeling is to unify visual comprehension and generation within a single model. However, the two tasks demand mismatched decoding regimes and visual representations, making it non-trivial to jointly optimize within a shared feature space. In this work, we present ***Cheers***, a unified multimodal model that decouples patch-level details from semantic representations, thereby stabilizing semantics for multimodal understanding and improving fidelity for image generation via gated detail residuals. ***Cheers*** includes three key components: (i) a unified vision tokenizer that encodes and compresses image latent states into semantic tokens for efficient LLM conditioning, (ii) an LLM-based Transformer that unifies autoregressive decoding for text generation and diffusion decoding for image generation, and (iii) a cascaded flow matching head that decodes visual semantics first and then injects semantically gated detail residuals from the vision tokenizer to refine high-frequency content. Experiments on popular benchmarks demonstrate that ***Cheers*** matches or surpasses advanced UMMs in both visual understanding and generation. Notably, ***Cheers*** outperforms the Tar-1.5B on the popular benchmarks GenEval and MMBench, while requiring only 20% of the training cost, indicating effective and efficient (i.e., 4x token compression) unified multimodal modeling. - **Repository:** [[https://github.com/AI9Stars/Cheers](https://github.com/AI9Stars/Cheers)] - **Paper:** [[https://arxiv.org/abs/2603.12793](https://arxiv.org/abs/2603.12793)]
## Model Evaluation ### compare with cheers ![image](https://cdn-uploads.huggingface.co/production/uploads/659fe10622e21292f8ee79b7/iwThNnCUS7VZpnv_-ykgL.png) ## 🔥 News - **[2026/03/19]** 🎉 [**Demo**](https://huggingface.co/spaces/prithivMLmods/Cheers-HF-Demo) is now available on Hugging Face. Thanks to [Prithiv Sakthi](https://github.com/prithivsakthiur) for setting it up! - **[2026/03/16]** 📢 The ***Cheers*** paper is officially released. - **[2026/03/16]** 🛠 We open-source the evaluation code and training pipeline. **Our codebase is highly efficient: training on 3.8M samples takes only about two days on a single machine with 8×A100 GPUs.** - **[2026/03/16]** 📦 The model checkpoints of ***Cheers*** are now available. ## Model Card Contact For any questions or collaborations, feel free to contact us : )

📧 MetaPDa@gmail.com   |    📧 guozonghao96@outlook.com   |    📧 yichen0zhang@gmail.com  

## 📖 Citation If you find ***Cheers*** useful, please cite ***Cheers*** technical report using this BibTeX. ```bibtex @article{zhang2026cheers, title={CHEERS: DECOUPLING PATCH DETAILS FROM SEMANTIC REPRESENTATIONS ENABLES UNIFIED MULTIMODAL COMPREHENSION AND GENERATION}, author={Zhang, Yichen and Peng, Da and Guo, Zonghao and Zhang, Zijian and Yang, Xuesong and Sun, Tong and Sun, Shichu and Zhang, Yidan and Li, Yanghao and Zhao, Haiyan and others}, journal={arXiv preprint arXiv:2603.12793}, year={2026} } ```