Story

In his recent talk Ilya S. said that the data running out is a fundamental constraint on the scaling laws. He said "we have but one internet".

But I don't understand: there is so much data in the real world beyond the internet. Webcams. Microphones. Cars. Robots... Everything can collect multimodal data and more importantly (for robots) even get feedback loops from reality.

So isn't data functionally infinite? And the only thing standing in the way is the number of sensors and open datastreams and datasets.

Please help me understand