Nvidia solves key challenge in robotics
Nvidia solves key challenge in robotics As the AI industry looks beyond language models, Nvidia is betting big on the buzzy new technology powering physical AI: world models. At Nvidia GTC Taipei at Computex, the company unveiled Cosmos 3, a new generalist world foundation model that it calls a "fully open omnimodel," capable of reasoning and generation across text, video, images, ambient sound and action. This iteration of the Cosmos world model family builds on a previous generations by providing improved generalization capabilities, which is a major barrier to physical AI development and deployment. "We wanted to build this Cosmo 3 model to help physical AI developers to build more generalizable physical AI models," Ming-Yu Liu, Nvidia's VP of Cosmos Labs, told The Deep View. Cosmos 3 debuts a number of world model innovations, Liu said: The model utilizes a new architecture called "mixture-of-transformers," which combines the best aspects of...