Nvidia Reportedly Delays Launch of Next-Gen AI Chips Amid Design Flaw

By Ali Azhar

August 11, 2024

The business world is increasingly relying on AI to be the next big technological advancement, and Nvidia is one of the key players that is powering this revolution.

With its market capitalization hitting $3 trillion earlier this year, the California-based chip manufacturer has witnessed a meteoric rise since the rise of GenAI. Nvidia’s revenue has surged dramatically, increasing by 262% year over year, highlighting the massive demand for its AI chips. However, the remarkable rise of Nvidia might be experiencing a serious obstacle.

According to a report by The Information, Nvidia AI chips will be delayed by three months or more due to design flaws that were discovered “unusually late in the production process.”

Customers who have ordered the new Blackwell flagship line of chips were expected to receive their shipments later this year but now may have to wait until 2025. The delay is expected to cause major disruption for customers such as Google, Microsoft, and Meta who already ordered tens of billions of dollars worth of Nvidia chips.

Several Nvidia customers are expected to launch new AI products and set up data centers by early next year, and this delay can cause significant disruption to their plans.

Google is estimated to have placed an order of more than 400,000 GB200 chips. Meta has also placed a similar order, while Microsoft wants at least 55,000 chips for OpenAI by the first quarter of next year.

The Blackwell AI chips are the successor to the hugely popular Nvidia H100 chips, which are powering the majority of GenAI applications around the globe. NVIDIA unveiled the Blackwell GPUs in March, claiming they deliver a performance boost of up to 30 times compared to the H100 while reducing energy consumption by as much as 25% on some workloads.

The design flaw was reportedly identified by Nvidia’s chip producer Taiwan Semiconductor Manufacturing Company (TSMC). A fresh set of test runs are being conducted on the AI chips.

According to The Information, the design flaw is with the processor die that connects the Blackwell GPUs on a single NVIDIA GB200 Superchip. Nvidia is now working on redesigning the die and will likely need a few months before it can move to production testing with TSMC.

There are reports that Nvidia is considering producing a single GPU version of the Blackwell series to fulfill its commitment to some customers. However, the performance impact of such a design would be risky.

Nvidia may prefer to delay the shipments rather than risk shipping out faulty or underperforming products, which is what appears to have happened with Intel’s 13th and 14th Gen Core processors. The instability issues of the Intel processors have plagued gamers since December 2023 and have become a major headache for the tech giant.

While NVIDIA may be able to afford the delay, any performance failures of its highly anticipated Blackwell chips could be catastrophic. Not only would it be a disaster for its reputation, but also be extremely costly.

GB200 compute tray featuring two Grace Blackwell Superchips (Image courtesy Nvidia)

A single GB200 Blackwell superchip can cost up to $70,000, while a complete server rack can cost more than $3 million. Given the volume of chips and servers Nvidia has committed to producing, any issues with the Blackwell chips could have severe financial repercussions for the company.

The delay in the AI chip arrives as Nvidia faces another setback. The chip manufacturer is subject to investigation from the U.S. Department of Justice over its AI practices. The investigation is probing into claims that Nvidia unfairly pressured cloud computing companies to buy its AI chips, and is also exploring potential antitrust violations related to Nvidia’s acquisition of the AI startup Run:ai.

Several of Nvidia’s customers are investing in hardware research to build their own AI products in-house. As a result, Nvidia must minimize the impact of the AI chip delay to maintain its leading position in the market. There is a lot at stake for Nvidia, and it must carefully navigate these challenges to ensure it continues to dominate the AI hardware industry.

Related Items 

NVIDIA Prepares New AI Chip for China Amid Ongoing US Export Controls 

Google’s Controversial AI Chip Paper Under Scrutiny Again  

Nvidia’s Superlove: First Superchip, Now Supermode 

 

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Quantum Companies D-Wave and Rigetti Again Face Stock Delisting

October 4, 2024

Both D-Wave (NYSE: QBTS) and Rigetti (Nasdaq: RGTI) are again facing stock delisting. This is a third time for D-Wave, which issued a press release today following notification by the SEC. Rigetti was notified of delisti Read more…

Alps Scientific Symposium Highlights AI’s Role in Tackling Science’s Biggest Challenges

October 4, 2024

ETH Zürich recently celebrated the launch of the AI-optimized “Alps” supercomputer with a scientific symposium focused on the future possibilities of scientific AI thanks to increased compute power and a flexible ar Read more…

The New MLPerf Storage Benchmark Runs Without ML Accelerators

October 3, 2024

MLCommons is known for its independent Machine Learning (ML) benchmarks. These benchmarks have focused on mathematical ML operations and accelerators (e.g., Nvidia GPUs). Recently, MLCommons introduced the results of its Read more…

DataPelago Unveils Universal Engine to Unite Big Data, Advanced Analytics, HPC, and AI Workloads

October 3, 2024

DataPelago today emerged from stealth with a new virtualization layer that it says will allow users to move AI, data analytics, and ETL workloads to whatever physical processor they want, without making code changes, the Read more…

IBM Quantum Summit Evolves into Developer Conference

October 2, 2024

Instead of its usual quantum summit this year, IBM will hold its first IBM Quantum Developer Conference which the company is calling, “an exclusive, first-of-its-kind.” It’s planned as an in-person conference at th Read more…

Stayin’ Alive: Intel’s Falcon Shores GPU Will Survive Restructuring

October 2, 2024

Intel's upcoming Falcon Shores GPU will survive the brutal cost-cutting measures as part of its "next phase of transformation." An Intel spokeswoman confirmed that the company will release Falcon Shores as a GPU. The com Read more…

The New MLPerf Storage Benchmark Runs Without ML Accelerators

October 3, 2024

MLCommons is known for its independent Machine Learning (ML) benchmarks. These benchmarks have focused on mathematical ML operations and accelerators (e.g., Nvi Read more…

DataPelago Unveils Universal Engine to Unite Big Data, Advanced Analytics, HPC, and AI Workloads

October 3, 2024

DataPelago today emerged from stealth with a new virtualization layer that it says will allow users to move AI, data analytics, and ETL workloads to whatever ph Read more…

Stayin’ Alive: Intel’s Falcon Shores GPU Will Survive Restructuring

October 2, 2024

Intel's upcoming Falcon Shores GPU will survive the brutal cost-cutting measures as part of its "next phase of transformation." An Intel spokeswoman confirmed t Read more…

How GenAI Will Impact Jobs In the Real World

September 30, 2024

There’s been a lot of fear, uncertainty, and doubt (FUD) about the potential for generative AI to take people’s jobs. The capability of large language model Read more…

IBM and NASA Launch Open-Source AI Model for Advanced Climate and Weather Research

September 25, 2024

IBM and NASA have developed a new AI foundation model for a wide range of climate and weather applications, with contributions from the Department of Energy’s Read more…

Intel Customizing Granite Rapids Server Chips for Nvidia GPUs

September 25, 2024

Intel is now customizing its latest Xeon 6 server chips for use with Nvidia's GPUs that dominate the AI landscape. The chipmaker's new Xeon 6 chips, also called Read more…

Building the Quantum Economy — Chicago Style

September 24, 2024

Will there be regional winner in the global quantum economy sweepstakes? With visions of Silicon Valley’s iconic success in electronics and Boston/Cambridge� Read more…

How GPUs Are Embedded in the HPC Landscape

September 23, 2024

Grasping the basics of Graphics Processing Unit (GPU) architecture is crucial for understanding how these powerful processors function, particularly in high-per Read more…

Shutterstock_2176157037

Intel’s Falcon Shores Future Looks Bleak as It Concedes AI Training to GPU Rivals

September 17, 2024

Intel's Falcon Shores future looks bleak as it concedes AI training to GPU rivals On Monday, Intel sent a letter to employees detailing its comeback plan after Read more…

Nvidia Shipped 3.76 Million Data-center GPUs in 2023, According to Study

June 10, 2024

Nvidia had an explosive 2023 in data-center GPU shipments, which totaled roughly 3.76 million units, according to a study conducted by semiconductor analyst fir Read more…

Granite Rapids HPC Benchmarks: I’m Thinking Intel Is Back (Updated)

September 25, 2024

Waiting is the hardest part. In the fall of 2023, HPCwire wrote about the new diverging Xeon processor strategy from Intel. Instead of a on-size-fits all approa Read more…

AMD Clears Up Messy GPU Roadmap, Upgrades Chips Annually

June 3, 2024

In the world of AI, there's a desperate search for an alternative to Nvidia's GPUs, and AMD is stepping up to the plate. AMD detailed its updated GPU roadmap, w Read more…

Ansys Fluent® Adds AMD Instinct™ MI200 and MI300 Acceleration to Power CFD Simulations

September 23, 2024

Ansys Fluent® is well-known in the commercial computational fluid dynamics (CFD) space and is praised for its versatility as a general-purpose solver. Its impr Read more…

Shutterstock_1687123447

Nvidia Economics: Make $5-$7 for Every $1 Spent on GPUs

June 30, 2024

Nvidia is saying that companies could make $5 to $7 for every $1 invested in GPUs over a four-year period. Customers are investing billions in new Nvidia hardwa Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Leading Solution Providers

Contributors

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

IBM Develops New Quantum Benchmarking Tool — Benchpress

September 26, 2024

Benchmarking is an important topic in quantum computing. There’s consensus it’s needed but opinions vary widely on how to go about it. Last week, IBM introd Read more…

Quantum and AI: Navigating the Resource Challenge

September 18, 2024

Rapid advancements in quantum computing are bringing a new era of technological possibilities. However, as quantum technology progresses, there are growing conc Read more…

Intel Customizing Granite Rapids Server Chips for Nvidia GPUs

September 25, 2024

Intel is now customizing its latest Xeon 6 server chips for use with Nvidia's GPUs that dominate the AI landscape. The chipmaker's new Xeon 6 chips, also called Read more…

Google’s DataGemma Tackles AI Hallucination

September 18, 2024

The rapid evolution of large language models (LLMs) has fueled significant advancement in AI, enabling these systems to analyze text, generate summaries, sugges Read more…

Microsoft, Quantinuum Use Hybrid Workflow to Simulate Catalyst

September 13, 2024

Microsoft and Quantinuum reported the ability to create 12 logical qubits on Quantinuum's H2 trapped ion system this week and also reported using two logical qu Read more…

IonQ Plots Path to Commercial (Quantum) Advantage

July 2, 2024

IonQ, the trapped ion quantum computing specialist, delivered a progress report last week firming up 2024/25 product goals and reviewing its technology roadmap. Read more…

US Implements Controls on Quantum Computing and other Technologies

September 27, 2024

Yesterday the Commerce Department announced export controls on quantum computing technologies as well as new controls for advanced semiconductors and additive Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire