AI & ML interests
AI & ML
Recent Activity
Cuntinum
We build dense foundation models that think differently.
Intelligence should not be sparse. Every token deserves access to everything the model knows.
What We Do
We are a research lab focused on building foundation models from first principles. Our work rejects the trend of making models bigger by making them emptier. Instead, we pursue architectures where every single inference path has access to the full knowledge capacity of the system.
Our models are dense by design. Not because we lack the engineering to build sparse alternatives, but because we believe the next leap in AI requires every parameter to participate in every thought.
Our Approach
We do not route tokens to subsets of experts. We do not drop knowledge based on a gating function's best guess. We build systems where intelligence is stored directly and retrieved instantly, where the model improves itself continuously, and where adding new capabilities never means forgetting old ones.
| Principle | What It Means |
|---|---|
| Fully Dense | Every token sees all knowledge. No routing, no dropping, no lottery. |
| Self Improving | The model learns permanently from its own operation. Training never truly ends. |
| Expandable | New capabilities attach without retraining existing ones. Growth is additive. |
| Unified | One architecture handles text, code, reasoning, vision, and audio. No ensembles. |
| Fast | Parallel generation at speeds that make autoregressive look quaint. |
Research Areas
Dense Knowledge SystemsDirect storage and retrieval architectures that scale to trillions of effective parameters without the memory overhead of naive dense models. Continuous LearningModels that update their own knowledge from every interaction without catastrophic forgetting or gradient based retraining. |
Multi Teacher DistillationAbsorbing the strengths of multiple specialist models into a single unified system that outperforms any individual teacher. Parallel GenerationMoving beyond one token at a time. Generating entire responses in parallel through learned denoising. |
Philosophy
Most large language models today are cocktail parties. Thousands of experts milling around, and a bouncer at the door decides which eight of them get to answer your question. The other thousands stand idle. We think that is a waste.
Our models are more like a single mind that has read everything, remembers everything, and brings all of it to bear on every single response. Dense. Focused. Complete.
We are not building a bigger model. We are building a better kind of model.
Cuntinum — Dense Intelligence