PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 140
RichardYu
imyuliz
·
AI & ML interests
LLM、Explore Toolchains based on LLM、AIOPS、Observability、Financial Technology
Organizations
upvoted a paper about 1 year ago
upvoted an article almost 2 years ago
Article
Mixture of Experts Explained
- +4
osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq
• • 1.13k