MoE++ - a Chat-UniVi Collection

Chat-UniVi 's Collections

MoE++

updated Mar 2

[ICLR 2025 Oral🔥] MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts

Chat-UniVi/MoE-Plus-Plus-7B

Text Generation • Updated Dec 7, 2024 • 27 • 5
MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts

Paper • 2410.07348 • Published Oct 9, 2024 • 1