Nvidia Launches AI for Hospital Operating Rooms

Robots are coming to hospitals, but they are not there to replace surgeons. Instead, they observe, coordinate and carry loads, tasks that consume large amounts of clinical staff time and require far less judgment than the work surgeons spend years training to perform.

That distinction is central to Nvidia’s latest push into healthcare. The company this week released what it describes as the first open platform built specifically for healthcare robotics, a stack of datasets, simulation tools and vision-language-action models designed to train artificial intelligence systems on surgical environments and deploy them in real clinical workflows.

In a company release, Nvidia said Johnson & Johnson MedTech, CMR Surgical, PeritasAI and Proximie are among the first adopters building on the platform.

The use cases fall into two categories. One is AI that watches surgery and surfaces information to clinicians in real time. The other is AI that handles the coordination work that fills a hospital’s hours between procedures.

That focus reflects a broader shift in how automation is entering healthcare. As outlined by Forbes, hospitals are turning to robotics to manage repetitive, coordination-heavy tasks as staffing shortages and cost pressures intensify.

The workforce pressure behind that shift is well-documented. The World Health Organization projects a global shortfall of 10 million health workers by 2030, while U.S. hospitals report operating below capacity due to staffing constraints. Those dynamics are making hospital administrators more willing to deploy automation in parts of the workflow that were previously considered too complex or too sensitive.

Second Set of Eyes

The most closely watched application is intraoperative assistance, where AI systems analyze live surgical video and surface real-time insights without directly controlling instruments.

Proximie is building in this direction, using Nvidia’s synthetic data tools to train models that combine still operating room images with live video. The goal is to identify anatomy, track procedural progress and provide contextual guidance to surgeons as procedures unfold.

The underlying infrastructure is designed to address a long-standing bottleneck in robotics: access to training data. Nvidia’s Open-H dataset includes 776 hours of surgical video collected from 35 organizations across multiple robotic systems and procedures. By pooling data across the ecosystem, developers can train models that generalize across environments rather than learning from narrow, proprietary datasets.

Simulation extends that capability further. Nvidia’s Cosmos-H models generate synthetic surgical data, allowing developers to test edge cases and rare scenarios without relying solely on real-world footage. The approach compresses development timelines and reduces iteration costs, enabling faster progress toward deployment.

The line Nvidia and its partners are drawing is deliberate. AI that observes and informs operates within a different regulatory and risk framework than AI that acts. Most current deployments focus on assistance, not autonomy, positioning these systems as a second set of eyes rather than a replacement for surgical expertise.

Logistics Work

The second category is less visible but potentially more immediate in its impact. Hospitals run on coordination: moving patients, tracking instruments, managing sterilization cycles and allocating equipment across departments. These tasks are high-volume, time-sensitive and largely handled by human staff.

PeritasAI is targeting this layer, training systems to manage instrument handling, sterile field coordination and operating room logistics. These are areas where automation can be deployed with lower clinical risk and faster return on investment.

The economic case is straightforward. Administrative and coordination tasks consume a significant share of hospital labor but do not require specialized clinical training. Automating them can free up staff time, improve throughput and reduce delays across the system.

For device makers, simulation introduces another advantage. Johnson & Johnson MedTech is using Nvidia’s platform to generate training data for its MONARCH system, reducing reliance on physical testing. In simulation, hundreds of scenarios can be run in minutes rather than days, accelerating development cycles for systems that would otherwise require extensive real-world validation.

For all PYMNTS AI coverage, subscribe to the daily AI Newsletter.