Rotation-Aligned Key Channel Pruning for Efficient Vision-Language Model Inference
Paper • 2605.19218 • Published
Efficient AI
CompactAttention: Accelerating Chunked Prefill with Block-Union KV Selection
RelayGen: Intra-Generation Model Switching for Efficient Reasoning