Run inference — Hayula Research

Hayula AI Lab

Abstract

DeepSeek V3 and R1 represent the frontier of Mixture-of-Experts language models at 671 billion total parameters (37B active per token). Current hardware limitations restrict deployment to multi-GPU clusters: no single H100 (80GB), A100 (80GB), or consumer GPU can load the model at any practical quantization level. We demonstrate that the Apple M2 Ultra with 192GB unified memory is the only consumer-grade hardware capable of running this architecture, at IQ1_M quantization (139GB) fitting entirel

Files

File Description
paper.md Full paper (Markdown)
README.md This model card

Citation

@techreport{hayulalab2026hiddentiger,
    title={Run inference — Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/hidden-tiger-paper}
}

hayulalab — Open Source AI Research

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support