Indigenous HPC: What It Means and Why Now

By Tiffany Trader

April 5, 2022

Supercomputing has become an indispensable asset for nations’ prosperity and security. In this timely Q&A, Hyperion Research Senior Adviser Steve Conway surveys the rise of so-called indigenous or sovereign HPC programs across the world. He examines the efforts of the most active regions, including the United States, which now finds its supercomputing leadership challenged by other countries and alliances. With the Russia-Ukraine war portending the end of globalization, the global state of domestic advanced computing has rarely been more relevant.

HPCwire: Initiatives to develop indigenous HPC technologies in pursuit of HPC sovereignty are gaining momentum around the world. Why?

Steve Conway: Governments have long recognized HPC’s importance for advanced research, but today governments also see HPC as crucial for economic competitiveness. That’s a major change. China, Europe and Japan, among others, are pursuing indigenous HPC technology initiatives because they believe HPC leadership is a prerequisite for economic as well as scientific and engineering leadership. Because political relations among countries can be uncertain, China and Europe don’t want to remain heavily dependent on the U.S. or other foreign sources for this critical technology. They want to attain HPC sovereignty by fostering homegrown technologies and supply chains. Japan’s situation is different because Japan has been an HPC technology leader for decades.

HPCwire: Can you summarize the main initiatives and the context for each of them?

Conway: I won’t do justice to these initiatives but let me try. The initiatives in China, Europe and Japan have some common elements, especially the central role assigned to developing indigenous processors, mostly based on industry-standard technology that can support broad sales by domestic HPC system vendors. Deep down, the global exascale race also turns out to be a processor race.

HPCwire: Let’s take the initiatives one at a time, starting with China.

Conway: China has made enormous progress in designing and deploying leading supercomputers featuring indigenous processors, and China may have deployed the world’s first exascale supercomputers but not yet reported them for Top500 listing. China’s semiconductor fabs are a generation or more behind global leaders, however, and the Made in China 2025 Plan, whose goals include 70 percent self-sufficiency in semiconductors by 2025, appears to be significantly behind schedule. U.S. government restrictions against importing foreign semiconductors have motivated China to accelerate indigenous development, but it will take some time for China to achieve semiconductor self-sufficiency in HPC or in other markets.

HPCwire: What about Europe?

Conway: Europe has also made great progress toward becoming one of the global leaders in producing and consuming HPC technology in the exascale era. Europe promises to be among the global leaders. Especially impressive are Europe’s achievements in organizing more than two dozen nations to pursue this goal through the EuroHPC Joint Undertaking, which among other things has already deployed eight or so pre-exascale supercomputers. Initiatives such as ETP4HPC and the European Processor Initiative have advanced indigenous technologies. Europe is poised to become the global leader in democratizing exascale technologies through its Centers of Excellence and SMB initiatives aimed at scientific and industrial researchers in participating countries. Europe doesn’t see HPC sovereignty as doing everything alone and is likely to continue collaborating with non-European HPC suppliers as the situation demands. Processor sovereignty will take a while but is well under way.

HPCwire: And finally, Japan.

Conway: Japan’s indigenous technology initiative is different. In the earlier, “hot box” era of proprietary vector supercomputers, Japan and the U.S. vied for global leadership. Japan was slower to shift to cluster architectures based on x86 processors and other industry-standard technologies. This caused Japanese system vendors to largely pull back from non-domestic markets. Japan’s government then followed a pattern of providing substantial funding about once a decade to develop a top-ranking supercomputer, such as the NEC Earth Simulator, first on the Top500 list from 2002 to 2004, and the Fujitsu K computer, first in 2011 and 2012. Fujitsu’s Fugaku system has headed the list since June 2020 and reflects a major shift toward higher-potential microprocessor technology, in this case Arm64, that could support significant adoption beyond Japan. Already multiple government sites in the U.S. and Europe are exploring Fugaku systems, and Riken is broadening its non-Japanese user community by awarding time on the number one supercomputer to international research teams.

HPCwire: Russia is one of the nations that was developing a native HPC ecosystem. What impact will Russia’s invasion of Ukraine have on indigenous HPC projects? What are the considerations there?

Conway: Russia’s government has acknowledged the importance of supercomputing but hasn’t made adequate funding available for a world-class exascale program or national HPC technology initiative, although innovation has continued at vendors such as RSC and others. Russia has four systems in the top 50 of the November 2021 Top500, all of them using processors from AMD and Nvidia, who along with Intel, TSMC and Global Foundries have suspended exports to Russia in compliance with U.S. restrictions following the invasion of Ukraine. Russia’s post-invasion disconnect from the SWIFT global financial messaging service is another problem, especially for selling outside of Russia. No quick workarounds seem available to Russian HPC vendors, who may need to revert temporarily to older process technology.

HPCwire: Some of these efforts were motivated by a desire or necessity to not be dependent on U.S. supply chains. Does the United States also have an “indigenous” HPC initiative even if it isn’t explicitly framed that way? Can you discuss some of the ways that the U.S. protects its interests?

Conway: In effect, the U.S. has had a continuous indigenous HPC technology initiative since the 1960s, driven by the defense and other government sectors, and more recently also by growing recognition of HPC’s importance for America’s economy. The 2021 CHIPS for America Act aims to secure the semiconductor supply chain, especially given that 88 percent of the U.S. semiconductor supply in 2020 was fabricated outside of the country. Related to this goal, TSMC and Samsung are building fabs in the U.S. as well as in Europe. Intel will now fab for outside customers and is increasing its footprint in Europe with plans for a large fabrication facility in Magdeburg, Germany. All of this says that the U.S. government recognizes that the global HPC and mainstream IT markets have become more competitive.

HPCwire: How realistic is the goal of HPC sovereignty? Doesn’t every country have some external supply chain dependencies? What about foundries specifically?

Conway: Today and for the foreseeable future, no country or global region can expect to have a fully independent HPC supply chain. Indigenous semiconductor production is typically seen as a cornerstone of HPC sovereignty, yet every major processor development initiative depends on non-domestic sources for some crucial supplies or capabilities, such as manufacturing in Taiwan and South Korea, lithium from China or advanced lithography equipment from the Netherlands. It follows that the goal should be supply chain security, ensuring that the supply chain consisting of domestic and non-domestic sources is as uninterruptible as possible.

HPCwire: Has the HPC community seen anything like this before? The ancient Romans said, “there’s nothing new under the sun.”

Conway: Yes, the world has seen this before. A concerted U.S. effort overtook the UK’s worldwide lead in the early computer era. Japan’s initiatives have challenged America’s HPC position since the 1980s. In the early 1990s, India began its Param supercomputer initiative that continues today, and China’s fast rise in HPC is due to a government push.

HPCwire: How successful have the indigenous HPC technology initiatives been so far? Are they on track?

Conway: HPC leadership takes years of continuous investment and is a never-ending effort. Chinese vendors are producing impressive leadership-class supercomputers but the effort to replace foreign semiconductors in China’s HPC and other IT markets is behind schedule, as I mentioned earlier. Europe, especially via the EuroHPC Joint Undertaking, has made very impressive progress and is positioning itself to become one of the global leaders in the exascale era. Given the enormous sums needed for new semiconductor facilities, Europe is wisely continuing to collaborate with non-European chipmakers while ramping up indigenous semiconductor innovation. Japan has long been an HPC leader and is taking important steps needed to increase global sales and research collaborations. The U.S. is responding to growing global competition through government initiatives such as the CHIPS Act and also by establishing more R&D facilities in Europe and elsewhere.

HPCwire: What are some of the challenges these initiatives still face?

Conway: I’ve mentioned some, but among the biggest challenges faced by some HPC vendors based in Europe and the Asia-Pacific region is gaining more global HPC market experience. To compete globally, you need access to as much of the global market as possible, because global revenue provides needed scale and the customer cultures and requirements can differ substantially from place to place. These varied requirements need to be designed into your products. Vendors that have sold HPC products only or mainly domestically are therefore at a temporary disadvantage. Related to that is the challenge of protective barriers, especially for European HPC vendors, because barriers are higher in the U.S., China and Japan. Addressing these so-called market asymmetries is a government-to-government matter.

HPCwire: How do you think these initiatives will play out in the global HPC market, especially with regard to competition and collaboration?

Conway: The next few years at least promise to be a time of transition, where these initiatives increasingly balance researchers’ need for uninterrupted access to the most capable supercomputers no matter where in the world they come from, and the goal of strengthening indigenous supply chains, which may mean favoring domestic suppliers in procurements. During this transition period, when some indigenous technologies and products under development may not be ready to compete with the world’s best, I would expect solutions that combine domestic and foreign elements as needed. Keep in mind that some non-domestic vendors, especially in the processor realm, are investing heavily in local facilities that should better enable them to qualify as domestic vendors in government procurements.

HPCwire: How can countries with smaller economies compete?

Conway:  Countries compete and align themselves with other countries in certain areas such as defense, but where HPC’s main function is concerned, research, the HPC community is increasingly global. HPC’s main contributions, such as severe weather prediction, safer vehicles and better energy exploration, have benefited humanity as a whole. So, the more important challenge is ensuring that researchers in countries of every size have access to HPC resources. The EuroCC program will establish HPC competence centers in 33 participating European countries, and Japan’s RIKEN is also broadening access for researchers in other countries of all sizes. Over time, this expanded use of HPC will benefit both science and domestic economies.

HPCwire: Summing up, then, how do you see these indigenous technology initiatives?

Conway:  They should ultimately increase competition and innovation in the global HPC market, giving buyers and users more choices. There may be temporary disruption as some governments learn to balance researchers’ needs with the goal of strengthening indigenous supply chains. In an ideal world, HPC competition would be free, fair and global, without the need for protective barriers, but the real world is politically divided. It’s reassuring that indigenous HPC technology initiatives aim to foster rather than restrict global research collaboration.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Empowering High-Performance Computing for Artificial Intelligence

April 19, 2024

Artificial intelligence (AI) presents some of the most challenging demands in information technology, especially concerning computing power and data movement. As a result of these challenges, high-performance computing Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that have occurred about once a decade. With this in mind, the ISC Read more…

2024 Winter Classic: Texas Two Step

April 18, 2024

Texas Tech University. Their middle name is ‘tech’, so it’s no surprise that they’ve been fielding not one, but two teams in the last three Winter Classic cluster competitions. Their teams, dubbed Matador and Red Read more…

2024 Winter Classic: The Return of Team Fayetteville

April 18, 2024

Hailing from Fayetteville, NC, Fayetteville State University stayed under the radar in their first Winter Classic competition in 2022. Solid students for sure, but not a lot of HPC experience. All good. They didn’t Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use of Rigetti’s Novera 9-qubit QPU. The approach by a quantum Read more…

2024 Winter Classic: Meet Team Morehouse

April 17, 2024

Morehouse College? The university is well-known for their long list of illustrious graduates, the rigor of their academics, and the quality of the instruction. They were one of the first schools to sign up for the Winter Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that ha Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use o Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pre Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announce Read more…

Nvidia’s GTC Is the New Intel IDF

April 9, 2024

After many years, Nvidia's GPU Technology Conference (GTC) was back in person and has become the conference for those who care about semiconductors and AI. I Read more…

Google Announces Homegrown ARM-based CPUs 

April 9, 2024

Google sprang a surprise at the ongoing Google Next Cloud conference by introducing its own ARM-based CPU called Axion, which will be offered to customers in it Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire