Nvidia sold half a million H100 AI GPUs in Q3 thanks to Meta, Facebook — lead times stretch up to 52 weeks: Report (2024)

Having earned$14.5 billion on datacenter hardwarein the third quarter of fiscal 2024, Nvidia clearly sold a boatload of its H100 GPUs for artificial intelligence (AI) and high-performance computing (HPC). Omdia says that Nvidia sold nearly half a million A100 and H100 GPUs, and demand for these products is so high that the lead time of H100-based servers is from 36 to 52 weeks.

Omdia, a market tracking company, believes that Meta and Microsoft are the largest purchasers of Nvidia's H100 GPUs. They procured as many as 150,000 H100 GPUs each, considerably more than the number of H100 processors purchased by Google, Amazon, Oracle, and Tencent (50,000 each). It is noteworthy thatthe majority of server GPUs are supplied to hyperscale cloud service providers. Server OEMs (Dell, Lenovo, HPE) cannot get enough AI and HPC GPUs to fulfill their server orders yet, Omdia claims.

The analyst firm believes that sales of Nvidia's H100 and A100 compute GPUs will exceed half a million units in Q4 2023. Meanwhile, demand for H100 and A100 is so strong that the lead time of GPU servers is up to 52 weeks. Meanwhile, Omdia says that server shipments for 2023 are trending between -17% and -20% year-over-year, whereas server revenue for 2023 is trending between +6% and +8% year-over-year.

Meanwhile, it should be noted that virtually all companies that purchase Nvidia's H100 GPUs in large quantities are also developing custom silicon for AI, HPC, and video workloads. As a result, their purchases of Nvidia hardware will likely decline over time as they transit to their own chips.