zunhaisu

zunhai's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored a paper 4 days ago

OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond

Paper • 2605.19660 • Published 7 days ago • 39

submitted a paper to Daily Papers 5 days ago

OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond

Paper • 2605.19660 • Published 7 days ago • 39

authored a paper about 1 month ago

Attention Sink in Transformers: A Survey on Utilization, Interpretation, and Mitigation

Paper • 2604.10098 • Published Apr 11 • 82

submitted a paper to Daily Papers about 1 month ago

Attention Sink in Transformers: A Survey on Utilization, Interpretation, and Mitigation

Paper • 2604.10098 • Published Apr 11 • 82

authored a paper 4 months ago

Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models

Paper • 2601.14004 • Published Jan 20 • 48

authored 4 papers 6 months ago

RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations

Paper • 2501.16383 • Published Jan 25, 2025

AKVQ-VL: Attention-Aware KV Cache Adaptive 2-Bit Quantization for Vision-Language Models

Paper • 2501.15021 • Published Jan 25, 2025

LongCat-Flash Technical Report

Paper • 2509.01322 • Published Sep 1, 2025 • 9

DoPE: Denoising Rotary Position Embedding

Paper • 2511.09146 • Published Nov 12, 2025 • 98

authored a paper 9 months ago

Unveiling Super Experts in Mixture-of-Experts Large Language Models

Paper • 2507.23279 • Published Jul 31, 2025 • 1