A new report warns that language models can go only so far, and that future progress depends on AI that can model the physical world.