Skip to main content

full timeline

Nvidia Vera Rubin AI platform rollout

Factlen Newsroom· Updated

Follow Nvidia Vera Rubin AI platform rollout in the Factlen app and get an alert when there is news. Get the app

Illustration: The DSX POD houses seven Vera Rubin racks and arrives with its internal cooling and cabling already completed.From: Nvidia Unveils Modular DSX POD Containers to Shrink AI Factory Deployment to 14 Days

Share this story

Latest

By 12:27 UTC on October 27, Nvidia unveiled its modular DSX POD containers, a reference design intended to reduce AI factory deployment times from months to as little as 14 days. The containerized system houses 504 Rubin GPUs across seven Vera Rubin racks, shifting rack integration, liquid cooling, cabling, piping, and testing into manufacturing facilities rather than onsite builds.

Achieving the 14-day deployment target requires destination sites to have power generation, cooling water, and network connectivity already prepared.

Prior to this hardware deployment shift, by 21:55 UTC on October 22, Google Cloud and Nvidia launched general availability for the Vera Rubin AI infrastructure through new A5X instances. The Google Cloud deployment scales up to 960,000 networked GPUs to meet the memory demands of autonomous AI agents. The rollout involved deep co-engineering to integrate Nvidia's networking and silicon into Google's liquid-cooled data centers, and Nvidia shares climbed over one percent following the announcement.

How the story developed

By 18:42 UTC on August 6, Nvidia introduced the Vera Rubin AI architecture, marking a shift in AI infrastructure from compute-bound to memory-bound design. The platform integrates a custom CPU and GPU into a unified rack-scale system.

The architecture was designed to drastically lower the cost of running complex agentic models. It utilizes HBM4 memory and NVLink 6 technology to eliminate traditional data movement bottlenecks.

Inside the DSX POD: The container packs over 500 GPUs and 17 kilometers of cabling into a road-transportable footprint.From: Nvidia Unveils Modular DSX POD Containers to Shrink AI Factory Deployment to 14 Days ·

By addressing these bottlenecks, the system promises a tenfold reduction in the cost of generating AI inference tokens. Additionally, training complex Mixture-of-Experts models on the new platform requires four times fewer GPUs compared to the previous generation.

At the time of the August unveiling, full production systems were projected to reach cloud providers in the second half of the year. This transition from announcement to availability materialized in late October with the initial cloud deployments and the introduction of containerized physical infrastructure.

Nvidia is funding massive supply chain expansions, including a 2.5x increase in substrate capacity, to support the new hardware.From: Nvidia Unveils Modular DSX POD Containers to Shrink AI Factory Deployment to 14 Days ·

What to watch

  • Hardware partners including Dell, HPE, and Lenovo are expected to begin delivering the modular factories in early 2027.

Key numbers

10x
Inference cost reduction per token
4x
Fewer GPUs required for MoE training
50 PFLOPS
NVFP4 inference performance per GPU
22 TB/s
HBM4 memory bandwidth per GPU
3.6 TB/s
NVLink 6 interconnect bandwidth

From: Nvidia Unveils Vera Rubin AI Architecture, Promising 10x Inference Cost Reduction

Charts, maps and images

The new A5X instances are designed to scale up to 960,000 networked GPUs.From: Google Cloud and NVIDIA Launch Vera Rubin AI Infrastructure for General Availability ·
NVIDIA's Rubin architecture aims to offset premium rental costs through massive efficiency gains.From: Google Cloud and NVIDIA Launch Vera Rubin AI Infrastructure for General Availability ·
Generational leaps in efficiency promised by the Vera Rubin architecture.From: Nvidia Unveils Vera Rubin AI Architecture, Promising 10x Inference Cost Reduction ·
Illustration: The 28,000-kilogram units are designed to be transported by truck and connected to prepared site infrastructure.From: Nvidia Unveils Modular DSX POD Containers to Shrink AI Factory Deployment to 14 Days ·
The Vera Rubin architecture relies on high-bandwidth memory to prevent bottlenecks during complex AI tasks.From: Google Cloud and NVIDIA Launch Vera Rubin AI Infrastructure for General Availability ·