Anjali has some amazing insights on token economics.

Prefill is compute constrained.

Decode is memory constrained.

So the ratio between input and output matters most for their costs.