MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Paper
•
2412.14590
•
Published
•
15
Xiaonan Song
xiaonans
·
AI & ML interests
None yet
Organizations
None yet
authored
a
paper
about 1 year ago