| --- |
| license: mit |
| library_name: LongCat-HeavyMode-Summary |
| pipeline_tag: text-generation |
| tags: |
| - transformers |
| --- |
| <div align="center"> |
| <img src="https://raw.githubusercontent.com/meituan-longcat/LongCat-Flash-Chat/main/figures/longcat_logo.svg" width="45%" alt="LongCat-Flash" /> |
| </div> |
| <hr> |
|
|
|
|
| <div align="center" style="line-height: 1;"> |
| <a href="https://longcat.ai/" target="_blank" style="margin: 2px;"> |
| <img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-LongCat--Flash--Thinking--2601-ADFF2F?color=29E154&logoColor=white" fill-opacity="1" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| <a href="https://github.com/meituan-longcat/LongCat-Flash-Thinking-2601"> |
| <img alt="github" src="https://img.shields.io/badge/🤖%20Github-LongCat--Flash--Thinking--2601-ff6b6b?color=1783ff&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| <div align="center" style="line-height: 1;"> |
| <a href="https://github.com/meituan-longcat/LongCat-Flash-Thinking-2601/blob/main/figures/wechat_official_accounts.png" target="_blank" style="margin: 2px;"> |
| <img alt="Wechat" src="https://img.shields.io/badge/WeChat-LongCat-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| <a href="https://x.com/Meituan_LongCat" target="_blank" style="margin: 2px;"> |
| <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-LongCat-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| <div align="center" style="line-height: 1;"> |
| <a href="https://huggingface.co/meituan-longcat/LongCat-Flash-Thinking-2601/blob/main/LICENSE" style="margin: 2px;"> |
| <img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| ## Model Introduction |
|
|
| We introduce an updated version of LongCat-Flash-Thinking, named LongCat-Flash-Thinking-2601, a powerful and efficient Large Reasoning Model (LRM) with 560 billion total parameters, built upon an innovative Mixture-of-Experts (MoE) architecture. |
|
|
| To push reasoning capability beyond current boundary, we established our **Heavy Thinking Mode** based on the LongCat-Flash-Thinking-2601. Specifically, we decompose challenging problem solving into two complementary stages: parallel thinking and summarization, thus jointly scaling both reasoning depth and width. For reasoning width scaling, under Heavy Thinking Mode, multiple trajectories are independently generated in a parallel manner, enabling broad exploration of reasoning paths. Reasonably high inference temperature here is applied to ensure possible diversity. For reasoning depth scaling, the refined trajectories during the summarization stage can be recursively fed back into the summary model, forming an iterative reasoning loop that supports progressively deeper reasoning. An additional reinforcement learning stage is specifically tailored to train the summarization ability, thus further unlocking the potential of this mode. |
|
|
| We now release our LongCat-HeavyModel-Summary model at [link](https://huggingface.co/meituan-longcat/LongCat-HeavyMode-Summary), which is further trained based on LongCat-Flash-Thinking-2601. |
|
|
| We've launched Heavy Thinking Mode on the Longcat AI platform. Feel free to try it out: https://longcat.chat/. |
|
|
|
|
