The Index

Topics.

Explore the ideas, systems, and engineering problems behind modern ML infrastructure.

01

Architecture

Transformers, MoE, SSMs, hybrids, and what's next.1 article