PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper
•
2504.08791
•
Published
•
139
•
10
tan90°
jianuo
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
10 days ago
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs
liked
a Space
about 1 month ago
MathematicalModelingAgent/MathematicalModelingAgent
commented on
a paper
6 months ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday
Home Clusters
Organizations
None yet
commented
2
papers
6 months ago