Using photos or videos, these AI systems can conjure simulations that train robots to function in physical spaces

Researchers working on large artificial intelligence models like ChatGPT have vast swaths of internet text, photos and videos to train systems. But roboticists training physical machines face barriers: Robot data is expensive, and because there aren't fleets of robots roaming the world at large, there simply isn't enough data easily available to make them perform well in dynamic environments, such as people's homes.