Community forum

Q&A

Questions, ideas, and experience shared by the ML Systems community.

← All discussionsStart a discussion

Sizing the KV-cache block pool vs. batch size with paged attention?

✓ answered
@HumbleBee14·Jul 17, 2026·1 reply·▲ 1