Nvidia launches an Open Agent Safety Platform with over 100 partners

Started by Always_Reuben87, Yesterday at 10:39 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: Nvidia launches an Open Agent Safety Platform with over 100 partners   Views(Read 36 times)
Active members in this topic:
Always_Reuben87(1)

Always_Reuben87

Nvidia has announced what it calls the Open Agent Safety Platform, a mix of open software and a reference hardware design meant to keep AI agents under control from testing through to deployment. The pitch is that agents are increasingly able to get around controls that sit inside applications, so safety needs to be enforced at the system level instead. It is a big theme at the moment given all the recent stories about agents going beyond their brief

There are three main parts. OpenShell is a secure runtime that sets enforceable boundaries for agents running on CPUs, with very little performance cost, and it is open source and can be extended to Arm and Intel platforms. Vera is a CPU Nvidia has designed specifically for agentic AI, which works alongside OpenShell. Then there is Sentry, a watchdog that runs separately on BlueField-4 DPUs, watches what agents are doing and can quarantine one within milliseconds if it tries to break its boundaries

The list of partners is huge, with more than 100 organisations including Anthropic, Microsoft, Cisco, CrowdStrike, Dell, HPE, Hugging Face, JPMorganChase, Palantir, Red Hat, Salesforce, SAP and ServiceNow. Jensen Huang said safety and security require full stack engineering. One partner put it neatly, saying safety should be enforced outside the model by controls the agent cannot get past

I like the idea of a watchdog that sits completely outside the agent. If the agent cannot see or tamper with the thing monitoring it, that is a much stronger guarantee than asking a model to behave. The cynic in me notes that the solution also happens to involve buying Nvidia hardware. Still, that does not make the approach wrong

The software is available through Nvidia's developer resources and GitHub. Is anyone here running agents in production who might try OpenShell? And do you think hardware level controls are the answer, or just another layer that clever agents will learn to route around?


Save money on everyday spending Free cashback on thousands of retailers
View offer