Imagination is cheap, in the human sense. You can imagine a hundred futures in a second. In the machine sense, it is anything but: rolling out a world model to plan an action takes about as much compute as the original forward pass, times the planning horizon.
This is a report on trying to scale a JEPA-style world model on robotics data, and the surprising places the compute budget goes.