Exascale Processor Proliferation? How Many Is Too Many?

By Bob Sorensen, Hyperion Research

May 30, 2018

With plans for exascale system developments around the world firming up and actual systems due to roll out on a near continual basis starting in 2020, one thing has become quite clear: the emphasis on being able to use indigenous processor technology is a key design goal for just about every major development effort out there. It appears that gone are the days when most HPC systems were essentially large clusters that tied together the most popular, most readily available, or primarily US-based commercial processors in sufficient quantities to reach the top of the Top 500 list. Instead, exascale developers are, for a number of reasons, increasingly looking inward for their processors bases.

Bob Sorensen, VP of research and technology and chief analyst for quantum computing, Hyperion

In China, there are at least three major exascale projects currently on the boards. Although it remains to be seen which of the pre-exascale prototypes, due to be available this year, will be selected for upgrade to exascale status, it is assured that it – or they – will be based on an indigenous Chinese processor. Indeed, each of the three Chinese prototypes use a different – and wholly unique – indigenous processor design. Likewise, recent announcements out of the EU have revealed that their overall exascale schedule will slip by at least a few years in order to take the time to design and develop the first European HPC processors and related accelerators.

In Japan, the Post-K system slated for delivery in 2022, is ostensibly an Arm-based design but in reality is decidedly a unique chip development effort by the Japanese computer maker, Fujitsu. Finally, US exascale development plans, centered primarily within the group of US Government sites charged with a host of national security applications, will once again turn to US-based processors, but perhaps with a twist. For the A21 system – the first US exascale system, slated to be installed at Argonne National Laboratory in 2021 – plans call for some form of novel chip architecture from Intel.

In the main, this trend towards more diverse and HPC-centric processors for the high-end is probably a good thing. Delivering exascale performance is no easy feat, and it is not readily obtainable simply by heaping together a sufficiently high pile of COTS[I] processors. Here, new designs that can address the demanding computational, memory, and interconnect requirements of exascale workloads likely require targeted exascale processors.

In addition, the profusion of new processor designs can only advance the state-of-the-art as a range of new features will be built, tested, and evaluated, and then either widely adopted or discarded depending on their efficacy. Finally, it can only help exascale processor development writ large that so many new HPC designers and developers from around the world – across a wide range of envisioned applications and workloads – are reaching down to the processor level to think about innovation, rather than simply using whatever the commercial sector makes available.

However, one has to wonder if there may be a downside to this trend. The most vexing concerns include:

  • Needless duplication of effort.
  • A more closed development environment that inhibits the sharing of successful ideas and designs.
  • Perhaps most important, the negative and far reaching impact on the overall HPC software stack that will need to respond to an increasingly diverse array of esoteric instruction sets and architectural eccentricities.

It is also unclear the impact such diverse processor development will have on the overall cost of designing, manufacturing, and delivering what could be a small set of custom processors with limited market potential, at least compared with general-purpose processor sector. Indeed, the cost of exascale systems and beyond could increasingly be driven, and then limited, by the costs associated with the development of these new processor bases.

Lastly, there are concerns that center not on technical issues but on geopolitical ones. Indeed, many of these exascale processor initiatives are driven not simply as a way to ensure a steady supply of indigenous components, but rather as a way to reduce dependence on foreign supply of chips. A number of legitimate concerns serve to reinforce this perspective including: US export control policies that can in the future – as they have in the past – shut off the supply of processors critical to foreign HPC makers; increased worries with privacy and data security issues that are forcing national governments to rethink their overall data security posture; and fundamental reservations about being left behind in the global exascale race due to the uneven availability – either intentionally or unintentionally – of world-class processors.

Ultimately, this exascale processor proliferation trend is a mixed bag. Sure, the sector will get some interesting, innovative, and frankly experimental processor designs that otherwise might not have ever seen the light of day. Also, more people will be looking at more options and designs for exascale processors, and HPC makers may have the ability to pick and choose the processor – or processors – that best fit their exascale offerings. However, the sector may undergo no small degree of fragmentation as stovepipes both technical and political arise unchecked. It would be a shame if this new emphasis on indigenous processors create more problems than it solves; exascale computing is already difficult enough.

Author Bio: Bob Sorensen is vice president of Research and Technology at Hyperion Research. He also spearheads Hyperion’s nascent quantum computing focus.

[i]Commercial Off the Shelf (COTS)

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Nvidia Debuts Turing Architecture, Focusing on Real-Time Ray Tracing

August 16, 2018

From the SIGGRAPH professional graphics conference in Vancouver this week, Nvidia CEO Jensen Huang unveiled Turing, the company's next-gen GPU platform that introduces new RT Cores to accelerate ray tracing and new Tenso Read more…

By Tiffany Trader

HPC Coding: The Power of L(o)osing Control

August 16, 2018

Exascale roadmaps, exascale projects and exascale lobbyists ask, on-again-off-again, for a fundamental rewrite of major code building blocks. Otherwise, so they claim, codes will not scale up. Naturally, some exascale pr Read more…

By Tobias Weinzierl

STAQ(ing) the Quantum Computing Deck

August 16, 2018

Quantum computers – at least for now – remain noisy. That’s another way of saying unreliable and in diverse ways that often depend on the specific quantum technology used. One idea is to mitigate noisiness and perh Read more…

By John Russell

HPE Extreme Performance Solutions

Introducing the First Integrated System Management Software for HPC Clusters from HPE

How do you manage your complex, growing cluster environments? Answer that big challenge with the new HPC cluster management solution: HPE Performance Cluster Manager. Read more…

IBM Accelerated Insights

Super Problem Solving

You might think that tackling the world’s toughest problems is a job only for superheroes, but at special places such as the Oak Ridge National Laboratory, supercomputers are the real heroes. Read more…

NREL ‘Eagle’ Supercomputer to Advance Energy Tech R&D

August 14, 2018

The U.S. Department of Energy (DOE) National Renewable Energy Laboratory (NREL) has contracted with Hewlett Packard Enterprise (HPE) for a new 8-petaflops (peak) supercomputer that will be used to advance early-stage R&a Read more…

By Tiffany Trader

STAQ(ing) the Quantum Computing Deck

August 16, 2018

Quantum computers – at least for now – remain noisy. That’s another way of saying unreliable and in diverse ways that often depend on the specific quantum Read more…

By John Russell

NREL ‘Eagle’ Supercomputer to Advance Energy Tech R&D

August 14, 2018

The U.S. Department of Energy (DOE) National Renewable Energy Laboratory (NREL) has contracted with Hewlett Packard Enterprise (HPE) for a new 8-petaflops (peak Read more…

By Tiffany Trader

CERN Project Sees Orders-of-Magnitude Speedup with AI Approach

August 14, 2018

An award-winning effort at CERN has demonstrated potential to significantly change how the physics based modeling and simulation communities view machine learni Read more…

By Rob Farber

Intel Announces Cooper Lake, Advances AI Strategy

August 9, 2018

Intel's chief datacenter exec Navin Shenoy kicked off the company's Data-Centric Innovation Summit Wednesday, the day-long program devoted to Intel's datacenter Read more…

By Tiffany Trader

SLATE Update: Making Math Libraries Exascale-ready

August 9, 2018

Practically-speaking, achieving exascale computing requires enabling HPC software to effectively use accelerators – mostly GPUs at present – and that remain Read more…

By John Russell

Summertime in Washington: Some Unexpected Advanced Computing News

August 8, 2018

Summertime in Washington DC is known for its heat and humidity. That is why most people get away to either the mountains or the seashore and things slow down. H Read more…

By Alex R. Larzelere

NSF Invests $15 Million in Quantum STAQ

August 7, 2018

Quantum computing development is in full ascent as global backers aim to transcend the limitations of classical computing by leveraging the magical-seeming prop Read more…

By Tiffany Trader

By the Numbers: Cray Would Like Exascale to Be the Icing on the Cake

August 1, 2018

On its earnings call held for investors yesterday, Cray gave an accounting for its latest quarterly financials, offered future guidance and provided an update o Read more…

By Tiffany Trader

Leading Solution Providers

SC17 Booth Video Tours Playlist

Altair @ SC17


AMD @ SC17


ASRock Rack @ SC17

ASRock Rack



DDN Storage @ SC17

DDN Storage

Huawei @ SC17


IBM @ SC17


IBM Power Systems @ SC17

IBM Power Systems

Intel @ SC17


Lenovo @ SC17


Mellanox Technologies @ SC17

Mellanox Technologies

Microsoft @ SC17


Penguin Computing @ SC17

Penguin Computing

Pure Storage @ SC17

Pure Storage

Supericro @ SC17


Tyan @ SC17


Univa @ SC17


  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This