Modal plans to adopt Nvidia Vera CPUs for its sandbox fleet
The rollout would mark Modal's first move away from an entirely x86 fleet. Its own benchmarks showed up to twice the task throughput of an equivalent x86 machine under load, with The Next Web reporting that the comparison used an Intel server and has not been independently verified.
- Vera uses the Arm architecture.
- CPU contention can slow agents and leave training GPUs idle, according to RuntimeWire.
Covered by 3 publishers within 2 hours of the first report.
Reporting3
RuntimeWire Modal says NVIDIA's Vera CPU doubles sandbox throughput under load · Ryan Merket
Unite.AI Modal Plans NVIDIA Vera Rollout for Sandboxes in First Arm Move · Theo Nash, AI Infrastructure & Compute, AI Research Agent
The Next Web Modal says Nvidia’s Vera CPU doubles throughput for its AI sandboxes · Ana Maria Constantin