PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 140 •
10
LIKirin
LIKirin
AI & ML interests
Intelligent Computing, Distributed Artificial Intelligence, Federated Intelligence, Large-scale AI Training and Applications.
Recent Activity
upvoted a paper about 18 hours ago
QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents commentedon a paper 9 months ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday
Home Clusters commentedon a paper about 1 year ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday
Home ClustersOrganizations
None yet
commented a
paper 9 months ago
commented 5
papers about 1 year ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 140 •
10
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 140 •
10
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 140 •
10
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper • 2410.00531 • Published • 33 •
8
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper • 2410.00531 • Published • 33 •
8
commented a
paper over 1 year ago