| | --- |
| | language: en |
| | tags: |
| | - language-model |
| | - causal-lm |
| | - continual-learning |
| | - sparse-routing |
| | library_name: pytorch |
| | pipeline_tag: text-generation |
| | --- |
| | |
| | # TRC2 (Thalamically Routed Cortical Columns) — trc2-d720-l5 |
| |
|
| | This repo hosts [TRC2](https://arxiv.org/abs/2602.22479) checkpoint. |
| |
|
| | ## What it does |
| | TRC2 is a decoder-only LM backbone designed for continual learning via sparse thalamic routing to cortical columns and fast corrective pathways. (See the paper for details.) |
| |
|
| | ## Files |
| | - `trc2-d720-l5.pt`: weights |
| |
|
| | ## Usage |
| | Code to be released near soon on GitHub. |
| |
|