NVIDIA announced at SIGGRAPH that its NVIDIA Agent Toolkit now includes NVIDIA Omniverse libraries, a collection of software components designed to equip AI agents with the tools and skills to add physical AI capabilities to existing applications. This integration enables AI agents to prepare 3D content for simulation, addressing the need for robots, factories, and autonomous systems to be designed and tested in virtual environments before real-world deployment.

Omniverse Libraries and Capabilities

The new Omniverse libraries extend the NVIDIA Agent Toolkit into 3D and physical AI workflows. The libraries, including ovrtx, ovphysx, and CAD-to-SimReady skills, are openly available on GitHub. They provide callable tools for sensor simulation, GPU-accelerated physics, and simulation-ready asset validation inside existing applications.

A new blueprint for integrating Omniverse libraries in Blender is also available on GitHub, demonstrating how software makers can add agent-ready simulation capabilities into existing 3D applications.

Industry Adoption and Integration

Software makers SideFX and PTC are integrating Omniverse libraries into their 3D applications. SideFX is using OpenUSD workflows, ovrtx, and ovphysx libraries to explore agent integration into its Houdini procedural 3D content creation workflows. PTC’s Onshape CAD and product data management platform is using OpenUSD and ovrtx to connect cloud-native design workflows with physical simulation.

Startups such as ForgeCAD, Lightwheel, Moonlake AI, and Palatial are also adopting these libraries. Palatial is using CAD-to-SimReady skills to automate asset creation, while Lightwheel is using Omniverse Content Agents to generate SimReady assets from text prompts.

Hardware Support and Availability

Workflows built with Omniverse libraries can run locally on systems ranging from compact RTX-powered units with NVIDIA RTX Spark to NVIDIA GB300-powered systems with NVIDIA DGX Station. RTX Spark systems will be available this fall from ASUS, Dell Technologies, HP, Lenovo, Microsoft Surface, and MSI, with models from Acer and GIGABYTE to follow. DGX Station systems are available to order from ASUS, Dell, GIGABYTE, HP, MSI, Supermicro, and Exxact.

Nvidia and Mitsubishi Heavy Industries are exploring a potential cooperation focused on cooling and power solutions for artificial intelligence data centers. The companies aim to leverage their respective expertise to enhance the efficiency and sustainability of AI infrastructure.

The proposed collaboration would address the critical challenges of heat generation and power consumption associated with high-performance AI computing. By combining Nvidia's advanced computing technologies with Mitsubishi Heavy Industries' energy and industrial capabilities, the partners seek to optimize data center operations.

This initiative reflects a broader industry trend toward integrating specialized cooling and power management systems to support the rapid expansion of AI applications. The partnership is expected to focus on developing innovative solutions that can scale with the increasing demands of AI workloads.

Details regarding the specific terms, timeline, or financial investment for the cooperation have not yet been disclosed. The companies are currently in the exploratory phase of the potential partnership.