Nvidia Reportedly Delays Launch of Next-Gen AI Chips Amid Design Flaw

By Ali Azhar

August 11, 2024

The business world is increasingly relying on AI to be the next big technological advancement, and Nvidia is one of the key players that is powering this revolution.

With its market capitalization hitting $3 trillion earlier this year, the California-based chip manufacturer has witnessed a meteoric rise since the rise of GenAI. Nvidia’s revenue has surged dramatically, increasing by 262% year over year, highlighting the massive demand for its AI chips. However, the remarkable rise of Nvidia might be experiencing a serious obstacle.

According to a report by The Information, Nvidia AI chips will be delayed by three months or more due to design flaws that were discovered “unusually late in the production process.”

Customers who have ordered the new Blackwell flagship line of chips were expected to receive their shipments later this year but now may have to wait until 2025. The delay is expected to cause major disruption for customers such as Google, Microsoft, and Meta who already ordered tens of billions of dollars worth of Nvidia chips.

Several Nvidia customers are expected to launch new AI products and set up data centers by early next year, and this delay can cause significant disruption to their plans.

Google is estimated to have placed an order of more than 400,000 GB200 chips. Meta has also placed a similar order, while Microsoft wants at least 55,000 chips for OpenAI by the first quarter of next year.

The Blackwell AI chips are the successor to the hugely popular Nvidia H100 chips, which are powering the majority of GenAI applications around the globe. NVIDIA unveiled the Blackwell GPUs in March, claiming they deliver a performance boost of up to 30 times compared to the H100 while reducing energy consumption by as much as 25% on some workloads.

The design flaw was reportedly identified by Nvidia’s chip producer Taiwan Semiconductor Manufacturing Company (TSMC). A fresh set of test runs are being conducted on the AI chips.

According to The Information, the design flaw is with the processor die that connects the Blackwell GPUs on a single NVIDIA GB200 Superchip. Nvidia is now working on redesigning the die and will likely need a few months before it can move to production testing with TSMC.

There are reports that Nvidia is considering producing a single GPU version of the Blackwell series to fulfill its commitment to some customers. However, the performance impact of such a design would be risky.

Nvidia may prefer to delay the shipments rather than risk shipping out faulty or underperforming products, which is what appears to have happened with Intel’s 13th and 14th Gen Core processors. The instability issues of the Intel processors have plagued gamers since December 2023 and have become a major headache for the tech giant.

While NVIDIA may be able to afford the delay, any performance failures of its highly anticipated Blackwell chips could be catastrophic. Not only would it be a disaster for its reputation, but also be extremely costly.

GB200 compute tray featuring two Grace Blackwell Superchips (Image courtesy Nvidia)

A single GB200 Blackwell superchip can cost up to $70,000, while a complete server rack can cost more than $3 million. Given the volume of chips and servers Nvidia has committed to producing, any issues with the Blackwell chips could have severe financial repercussions for the company.

The delay in the AI chip arrives as Nvidia faces another setback. The chip manufacturer is subject to investigation from the U.S. Department of Justice over its AI practices. The investigation is probing into claims that Nvidia unfairly pressured cloud computing companies to buy its AI chips, and is also exploring potential antitrust violations related to Nvidia’s acquisition of the AI startup Run:ai.

Several of Nvidia’s customers are investing in hardware research to build their own AI products in-house. As a result, Nvidia must minimize the impact of the AI chip delay to maintain its leading position in the market. There is a lot at stake for Nvidia, and it must carefully navigate these challenges to ensure it continues to dominate the AI hardware industry.

Related Items 

NVIDIA Prepares New AI Chip for China Amid Ongoing US Export Controls 

Google’s Controversial AI Chip Paper Under Scrutiny Again  

Nvidia’s Superlove: First Superchip, Now Supermode 

 

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Argonne’s HPC/AI User Forum Wrap Up

September 11, 2024

As fans of this publication will already know, AI is everywhere. We hear about it in the news, at work, and in our daily lives. It’s such a revolutionary technology that even established events focusing on HPC specific Read more…

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be natively integrated into four of the world's most advanced qu Read more…

Computing-Driven Medicine: Sleeping Better with HPC

September 10, 2024

As a senior undergraduate student at Fisk University in Nashville, Tenn., Ifrah Khurram's calculus professor, Dr. Sanjukta Hota, encouraged her to apply for the Sustainable Research Pathways Program (SRP). SRP was create Read more…

LLNL Engineers Harness Machine Learning to Unlock New Possibilities in Lattice Structures

September 9, 2024

Lattice structures, characterized by their complex patterns and hierarchical designs, offer immense potential across various industries, including automotive, aerospace, and biomedical engineering. With their outstand Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, integrated, and secured data. Now scientists working at univer Read more…

xAI Colossus: The Elon Project

September 5, 2024

Elon Musk's xAI cluster, named Colossus (possibly after the 1970 movie about a massive computer that does not end well), has been brought online. Musk recently posted the following on X/Twitter: "This weekend, the @xA Read more…

Shutterstock 793611091

Argonne’s HPC/AI User Forum Wrap Up

September 11, 2024

As fans of this publication will already know, AI is everywhere. We hear about it in the news, at work, and in our daily lives. It’s such a revolutionary tech Read more…

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be n Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, in Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Shutterstock 1897494979

What’s New with Chapel? Nine Questions for the Development Team

September 4, 2024

HPC news headlines often highlight the latest hardware speeds and feeds. While advances on the hardware front are important, improving the ability to write soft Read more…

Critics Slam Government on Compute Speeds in Regulations

September 3, 2024

Critics are accusing the U.S. and state governments of overreaching by including limits on compute speeds in regulations and laws, which they claim will limit i Read more…

Shutterstock 1622080153

AWS Perfects Cloud Service for Supercomputing Customers

August 29, 2024

Amazon's AWS believes it has finally created a cloud service that will break through with HPC and supercomputing customers. The cloud provider a Read more…

HPC Debrief: James Walker CEO of NANO Nuclear Energy on Powering Datacenters

August 27, 2024

Welcome to The HPC Debrief where we interview industry leaders that are shaping the future of HPC. As the growth of AI continues, finding power for data centers Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

Atos Outlines Plans to Get Acquired, and a Path Forward

May 21, 2024

Atos – via its subsidiary Eviden – is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more…

AMD Clears Up Messy GPU Roadmap, Upgrades Chips Annually

June 3, 2024

In the world of AI, there's a desperate search for an alternative to Nvidia's GPUs, and AMD is stepping up to the plate. AMD detailed its updated GPU roadmap, w Read more…

Nvidia Shipped 3.76 Million Data-center GPUs in 2023, According to Study

June 10, 2024

Nvidia had an explosive 2023 in data-center GPU shipments, which totaled roughly 3.76 million units, according to a study conducted by semiconductor analyst fir Read more…

Shutterstock_1687123447

Nvidia Economics: Make $5-$7 for Every $1 Spent on GPUs

June 30, 2024

Nvidia is saying that companies could make $5 to $7 for every $1 invested in GPUs over a four-year period. Customers are investing billions in new Nvidia hardwa Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Google Announces Sixth-generation AI Chip, a TPU Called Trillium

May 17, 2024

On Tuesday May 14th, Google announced its sixth-generation TPU (tensor processing unit) called Trillium.  The chip, essentially a TPU v6, is the company's l Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Leading Solution Providers

Contributors

IonQ Plots Path to Commercial (Quantum) Advantage

July 2, 2024

IonQ, the trapped ion quantum computing specialist, delivered a progress report last week firming up 2024/25 product goals and reviewing its technology roadmap. Read more…

Intel’s Next-gen Falcon Shores Coming Out in Late 2025 

April 30, 2024

It's a long wait for customers hanging on for Intel's next-generation GPU, Falcon Shores, which will be released in late 2025.  "Then we have a rich, a very Read more…

Some Reasons Why Aurora Didn’t Take First Place in the Top500 List

May 15, 2024

The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more…

Department of Justice Begins Antitrust Probe into Nvidia

August 9, 2024

After months of skyrocketing stock prices and unhinged optimism, Nvidia has run into a few snags – a  design flaw in one of its new chips and an antitrust pr Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

MLPerf Training 4.0 – Nvidia Still King; Power and LLM Fine Tuning Added

June 12, 2024

There are really two stories packaged in the most recent MLPerf  Training 4.0 results, released today. The first, of course, is the results. Nvidia (currently Read more…

Spelunking the HPC and AI GPU Software Stacks

June 21, 2024

As AI continues to reach into every domain of life, the question remains as to what kind of software these tools will run on. The choice in software stacks – Read more…

xAI Colossus: The Elon Project

September 5, 2024

Elon Musk's xAI cluster, named Colossus (possibly after the 1970 movie about a massive computer that does not end well), has been brought online. Musk recently Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire