Tag

#MoE

1 article tagged MoE.

What we've been getting wrong about MoE routing

Architecture

Top-k routing has become a default. It shouldn't be. A look at the tradeoffs nobody's measuring and the experiments that change my mind.

Hugo Belmar Oct 28, 2026