Real-Time Generative Simulation for Surgical Robotics

NVIDIA introduces Cosmos-H-Dreams, an action-conditioned, real-time generative simulator for surgical robotics. This system represents a major advancement over conventional simulators, which struggle to model the complexity of surgical scenes (deformable tissues, fine interactions, specular surfaces).

Cosmos-H-Dreams is a distillation of the Cosmos-H-Surgical-Simulator foundation model. It allows for faster and safer evaluation and training of surgical robotic systems than costly physical platforms. Thanks to teacher-student learning and self-reinforced distillation techniques, combined with the FlashDreams inference library, it achieves interactive performance of 160 frames per second on a single NVIDIA RTX PRO 6000 GPU. This paves the way for applications such as low-latency tele-supervision, procedure planning, and intraoperative decision support, by providing a shared physical AI environment for education, synthetic data generation, and policy evaluation.