| # LongCat-2.0 |
|
|
| <div align="center"> |
| <img src="figures/longcat_logo.svg" width="45%" alt="LongCat-2.0" /> |
| </div> |
| <hr> |
|
|
| <div align="center" style="line-height: 1;"> |
| <!-- <a href="https://longcat.ai/" target="_blank" style="margin: 2px;"> |
| <img alt="Chat" src="https://img.shields.io/badge/π€%20Chat-LongCat--Flash--Chat-ADFF2F?color=29E154&logoColor=white" fill-opacity="1" style="display: inline-block; vertical-align: middle;"/> |
| </a> --> |
| <a href="https://huggingface.co/meituan-longcat" target="_blank" style="margin: 2px;"> |
| <img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-LongCat-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| <div align="center" style="line-height: 1;"> |
| <a href="https://github.com/meituan-longcat/LongCat-2.0/blob/main/figures/wechat_official_accounts.png" target="_blank" style="margin: 2px;"> |
| <img alt="Wechat" src="https://img.shields.io/badge/WeChat-LongCat-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| <!-- <a href="https://discord.gg/EXsG52D8SW"> |
| <img src="https://img.shields.io/badge/Discord-Join%20Chat-5865F2?logo=discord&logoColor=white" /> |
| </a> --> |
| <a href="https://x.com/Meituan_LongCat" target="_blank" style="margin: 2px;"> |
| <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-LongCat-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| <div align="center" style="line-height: 1;"> |
| <a href="LICENSE" style="margin: 2px;"> |
| <img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/> |
| </a> |
| </div> |
| |
| <p align="center"> |
| <a href="https://longcat.chat/blog/longcat-2.0"><b>Tech Blog</b> π</a> |
| </p> |
|
|
| ## Model Introduction |
| We introduce LongCat-2.0, a large-scale MoE language model with **1.6 trillion total parameters** and ~48 billion activated per token β a substantial step up from previous LongCat models, accompanied by several architectural improvements. |
|
|
| Both the full training run and the large-scale deployment are built entirely on **AI ASIC superpods**. Pretraining spans millions of accelerator-hours across more than 35 trillion tokens, with no rollbacks or irrecoverable loss spikes β demonstrating that we have the capability to conduct frontier-scale training on alternative hardware platforms. |
|
|
| To strengthen the model on long-horizon tasks, we introduce LongCat Sparse Attention and train LongCat-2.0 on hundreds of billions of tokens of **1M-context** data. Together with dedicated post-training, this gives LongCat-2.0 strong performance on coding and agentic tasks. |
|
|
| --- |
|
|
| > [!NOTE] |
| > ποΈ **Model weights coming soon** β stay tuned! |
|
|