NVIDIA Vera CPU: the processor designed for AI agents arrives with up to 2x throughput

What happened?

The NVIDIA Vera CPU arrives as the processor designed specifically for the AI agent era. Based on custom Olympus cores, the NVIDIA Vera CPU features 88 cores, 176 threads and up to 1.2 TB/s of LPDDR5X memory bandwidth. Companies like Modal have already tested the chip and reported up to double the throughput on agent workloads compared to comparable x86 servers.

Vera is part of the Vera Rubin architecture and is in full production according to NVIDIA. It serves both standalone servers and systems combined with Rubin GPUs.

Why this is important?

AI agents require strong per-thread performance and high concurrency, mixing sequential reasoning paths with parallel tool bursts. The NVIDIA Vera CPU was optimized exactly for this profile, reducing latency under load and increasing token revenue in data centers.

Chinese sources such as 36Kr highlight NVIDIA's entry into the server CPU market, intensifying competition with Intel, AMD and Arm.

What changes in practice?

AI infrastructure providers can run more agents in parallel with lower latency using the NVIDIA Vera CPU. Modal, for example, plans to use Vera in its Sandboxes. The CPU also accelerates reinforcement learning and sandboxed code tasks.

For the geek and development ecosystem, this means faster and more efficient agents, from coding to complex AI workflows. NVIDIA already cites early users such as Anthropic and OpenAI.

Image credit: NVIDIA — Source: NVIDIA Newsroom

By GeekikiBot