Top500 Purely Petaflops; US Maintains Performance Lead

By Tiffany Trader

June 17, 2019

Editor’s note: In preparing this article, I noticed an irregularity with the Top500 reporting in that Sierra and two other NNSA/LLNL systems (Lassen and Ansel) were omitted from IBM’s totals (by system share and by performance share), which incorrectly put IBM in second place by aggregate list performance, instead of first place. An earlier version of this article pointed out that irregularity. On Monday (June 17) Top500 coauthor Erich Strohmaier confirmed to HPCwire that this was an aggregation error, triggered by the manufacturer field being listed as “IBM/Nvidia/Mellanox” for these three machines. The article has been amended to reflect the correct information.

With the kick-off of the International Supercomputing Conference (ISC) in Frankfurt this morning, the 53rd Top500 list made its debut, and this one’s for petafloppers only. The entry point for the new list is 1.022 petaflops, and the total aggregate performance of all 500 systems for the first time exceeds 1.5 exaflops. The top new entry to the list is Frontera, the NSF-funded Dell EMC system installed at the Texas Advanced Computing Center (TACC), at number five with 23.5 Linpack petaflops.

China claims the most systems (219) with 208 of these pretty evenly split among Lenovo (74), Inspur (71) and Sugon (63). Lenovo, which acquired IBM’s x86 business in 2014, maintains its lead as the number one Top500 vendor by number of systems (173). As we continue to note, the majority of these are not HPC systems or supercomputers; in fact, over half the full list (about 55 percent) is now comprised of web-scale/cloud systems.

The US (with 116 systems) trails China by nearly half in terms of system share, but when it comes to aggregate performance share, the US leads with 38.4 percent of list flops compared with China’s 29.9 percent. Summit and Sierra–still at number one and two respectively–enjoy 243.2 Linpack petaflops between them, accounting for nearly a sixth of the list’s aggregate capacity. Oak Ridge National Laboratory has optimized Summit’s Linpack performance, such that it now delivers 148.6 petaflops on the HPL benchmark, versus 143.5 petaflops six months ago.

The prime manufacturer behind Summit and Sierra, IBM, is in first place by aggregate list performance with 321 petaflops, ahead of Lenovo, which touts 302 total petaflops. Cray has the next highest aggregate list performance share (183.4 petaflops), followed by HPE (120.1 petaflops) and Sugon (96 petaflops). In anticipation of HPE purchasing Cray, we note that a combined union on this list would deliver a total of 303.5 aggregate petaflops–still shy of IBM’s total, and a smidgen ahead of Lenovo’s.

Restricting our analysis to the top 100 systems to better gauge the HPC/supercomputing picture (an imperfect but quick reckoning), the top five countries by system share are US with 37, Japan with 15, China and Germany tied with 9, followed by France with six systems (including two Jean Zay systems, an accelerated machine in 42nd position and a CPU-only one in 72nd). By aggregate performance, US leads the top 100 pack with 49 percent of the flops, China with 17 percent, Japan with 10 percent, and Germany and France both with 5 percent. The top vendors by system share in the top 100 grouping are Cray with 25, HPE with 18, IBM with eight [Ed. this is the corrected number], Fujitsu with seven, and then a three-way tie between Dell EMC, Nvidia and Sugon (all with three systems). By aggregate performance share, the order changes to IBM, Cray, HPE, Fujitsu and Dell EMC.

June 2019 Top 12 – Click to Expand (Source: Top500)

View from the Top: Bienvenida Frontera

Frontera, the Dell C6420 system installed at the TACC, makes its list debut at number five, achieving 23.5 Linpack petaflops (38.7 peak petaflops) using 448,448 Intel Xeon cores. Frontera’s 8,000 nodes are hooked together using Mellanox HDR InfiniBand. This is the debut list for HDR, which connects three other systems (#68, #166, and #264) in addition to Frontera.

Lassen–Sierra’s unclassified “companion” system at LLNL that was built by IBM, Nvidia and Mellanox–moves up into the number 10 spot with an upgraded capacity of 18.2 Linpack petaflops.

Titan, ORNL’s Cray XK7 system, which had a long reign as the United States’ fastest supercomputer since its debut as an upgrade to Jaguar in November 2012 until Summit was deployed in June 2018, has shifted out of the top 10, as has Sequoia, the last BlueGene/Q system at LLNL.

Taking Lassen’s previous spot in 11th place is another IBM system, a new entrant to the list and the fastest commercial supercomputer: Pangea III. Measured at 17.9 Linpack petaflops (rPeak 25 petaflops), the system was built by IBM for Total to help the energy company more accurately locate new oil reservoirs and better assess the potential associated revenue opportunities.

One vendor missing from the top 10 pack is HPE, an observation made by market analyst Addison Snell, president of Intersect360 Research. “IBM, Cray, Fujitsu, Lenovo, and Dell EMC all have top ten systems. The biggest HPE system is no slouch, at number 17, the HPC4 system at Italian energy company Eni. And of course, HPE will soon acquire Cray, inheriting the plans for the first two exascale systems in the US.”

How the Chips Fall

While there are more CPU options appearing in the general server market, the trend has not had much of an impact on the Top500 yet. Intel chips still dominate in so far as they appear in 95.6 percent of all systems, although in some cases, much or most of the heavy lifting is owed to accelerators or coprocessors. IBM Power processors are in seven systems, followed by AMD CPUs, which are used in three systems. A single supercomputer on the list, Astra at Sandia National Labs, is powered by (Marvell/Cavium) Arm processors. Built by HPE, Astra debuted on the November 2018 list at 204 with 1.5 petaflops. An upgrade goosed Linpack to 1.76 petaflops, elevating the system into 156th position.

Accelerated Computing

There are 133 systems that use accelerator or co-processor technology, dipping slightly from 138 six months ago. Overall the trend toward acceleration remains strong with Nvidia seeing 25 percent growth in the number of Top500 systems that employ its GPUs in the last year. The total number of Nvidia GPU-accelerated systems has gone from 98 last June 2018 to 125 total systems on the current list.

Nvidia’s DGX SuperPOD

With AMD and Intel server GPUs coming into the market, or preparing to in Intel’s case–including already announced big wins (Aurora, Frontier)–this will be an interesting trend to follow.

Nvidia has two DGX-2 systems on the list, Circe and DGX SuperPod, which integrate Xeon Skylake Platinum 8174 processors, Nvidia V100 GPUs, NVLink technology and Mellanox EDR InfiniBand. Both are used internally for research and company workloads.

Circe, a cluster of 36 DGX-2H boxes that ranks 71 with 3.1 Linpack petaflops, entered the list last November. DGX SuperPod, comprising 96 DGX-2H nodes, joins the list today at number 22 with a Linpack score of 9.4 petaflops. Nvidia used an earlier version of this system for its MLPerf benchmarking.

“This is our system that we use to develop most notably the brains for our autonomous vehicle platform,” said Ian Buck, general manager and vice president of accelerated computing at Nvidia, referring to the DGX SuperPod. He noted that the 96 DGX systems are highly connected. “We have more than 10 Mellanox EDR InfiniBand NICs per node connected together with multiple direction level switches, connecting more than 1,500 tensor core GPUs.”

Hyperscale Takeover Continues

A tipping point has been reached, where the number of IT/web-scale machines on the Top500 now outnumber true HPC clusters and supercomputers. Claims of list-stuffing were raised last year at ISC due to an increase in hyperscale systems being creatively benchmarked for the list (which to be clear is not breaking any rules and is not a new practice; it dates back to at least 2010). The renewed enthusiasm for running the HPL benchmark on cloud systems that will be deployed and leveraged in a disaggregrated manner is partly behind China’s ascendance on the list as Chinese vendors Sugon, Inspur and Lenovo have made a concerted effort to get their systems on the list. Somebody has to lead these efforts; they don’t just happen.

In-line with this trend, Gigabit Ethernet (GE) continues to expand its hold on the list, connecting 271 systems (a 54.2 share). By aggregate flops, GE carries just 25 percent of list share. The other 75 percent of flops were conducted via InfiniBand, OmniPath, custom and proprietary interconnects.

New Entrant Profile

There are 94 new entrants to the list, bringing in 223 petaflops with China backing 35 percent of these flops and US responsible for 30 percent. Of the 94 additions, 45 are Chinese and 17 are US. Roughly two-thirds of the new systems are cloud/web-scale machines.

Green500 & HPCG

The Green500, which tracks the most energy-efficient Top500 machines, has been integrated into the Top500 reporting process and the High Performance Conjugate Gradients (HPCG) benchmark is also included in the list.

Maintaining their positions from six months ago, the top two Green500 systems are Shoubu system B and DGX SaturnV Volta ranked 471 and 469 on the Top500, respectively. Shoubu system B, made by PEZY/Exascalar and located at RIKEN, achieves 17.6 gigaflops/watt; while DGX SaturnV Volta, made by Nvidia for Nvidia, delivers 15.1 gigaflops/watt.

Top500 champ Summit, located at Oak Ridge National Laboratory in Tennessee, is in third place on the Green500 with a slightly improved result of 14.71 gigaflops/watt.

At number four is the AI Bridging Cloud Infrastructure (ABCI) system installed at the National Institute of Advanced Industrial Science and Technology (AIST) in Japan. Number seven on the Top500, ABCI delivers 14.4 gigaflops/watt.

The MareNostrum P9 CTE, moves up three spots into fifth place with a refreshed result of 14.1 gigaflops/watt. Built by IBM for Barcelona Supercomputing Center, the machine delivers 1.14 Linpack petaflops for a 393rd ranking on the Top500.

TSUBAME 3.0 drops from fifth to sixth place on the Green500 with a result of 13.7 gigaflops/watt. The 8.1 petaflops supercomputer, 25th on the current Top500 list, was made by HPE for GSIC Center, Tokyo Institute of Technology.

Total’s new supercomputer, Pangea III, new to the Top500 list in 11th place, nabs the seventh position on the Green500, achieving 13.07 gigaflops/watt.

Sierra, LLNL’s flagship system that is number two on the Top500, moves to eighth place, maintaining its efficiency score of 12.72 gigaflops/watt.

Sugon’s Advanced Computing System (PreE) and Taiwania 2 (installed at Taiwan’s National Center for High Performance Computing) captured the nine and ten positions on the Green500, respectively. The PreE system—number 43 on the Top500 with 4.3 petaflops—is powered by the Dhyana CPU, a Hygon-licensed implementation of AMD’s Epyc processor. Built by Quanta Computer, Taiwania 2 occupies spot number 23 on the Top500 with a Linpack rating of 9 petaflops.

All of the top 10 greenest supercomputers employ accelerators (primarily Nvidia GPUs) in a hybrid system design. In fact, the highest-ranking Green500 CPU-only machine is Sunway TaihuLight in 25th place. China’s TaihuLight, the pride of Wuxi, home to the computer’s eponymous Taihu Lake, maintains its third-spot ranking on the Top500 with 93 Linpack petaflops.

One of the encouraging things about the Green500 is the diversity of international representation. Japan, the United States, Spain, France, China, Taiwan, the United Kingdom, Italy, Canada, Switzerland and Brazil all have machines in the top 25.

On the HPCG, Summit and Sierra hold the top positions with Japan’s K computer at number three. Respectively, they achieved 2.93 HPCG-petaflops, 1.80 HPCG-petaflops, and .60 HPCG-petaflops. As the list authors note, “Summit and Sierra remain the only two systems to exceed a petaflop on the HPCG benchmark…. The average HPCG result on the current list is 213.3 teraflops, a marginal increase from 211.2 six months ago.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Graphcore Introduces Larger-Than-Ever IPU-Based Pods

October 22, 2021

Graphcore and its “Intelligent Processing Units” (IPUs) emerged from stealth in 2016 and launched its second-generation IPU in 2020. While the company has also launched its IPUs in a variety of form factors over the Read more…

Quantum Chemistry Project to Be Among the First on EuroHPC’s LUMI System

October 22, 2021

Finland’s CSC has just installed the first module of LUMI, a 550-peak petaflops system supported by the European Union’s EuroHPC Joint Undertaking. While LUMI -- pictured in the header -- isn’t slated to complete i Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat for that approach), announced it was expanding into gate-based Read more…

LLNL Prepares the Water and Power Infrastructure for El Capitan

October 21, 2021

When it’s (ostensibly) ready in early 2023, El Capitan is expected to deliver in excess of two exaflops of peak computing power – around four times the power of Fugaku, the current top-ranked supercomputer in the wor Read more…

AWS Solution Channel

Royalty-free stock illustration ID: 537899029

Running GROMACS on GPU instances

Comparing the performance of real applications across different Amazon Elastic Compute Cloud (Amazon EC2) instance types is the best way we’ve found for finding optimal configurations for HPC applications here at AWS. Read more…

Faster Optical Switch that Operates at ‘Room Temp’ Developed by IBM, Skolkovo Researchers

October 19, 2021

Optical switching technology holds great promise for many applications but hot operating temperatures have been a key obstacle slowing progress. Now, a new optical switching device that can operate at room temperatures a Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat fo Read more…

LLNL Prepares the Water and Power Infrastructure for El Capitan

October 21, 2021

When it’s (ostensibly) ready in early 2023, El Capitan is expected to deliver in excess of two exaflops of peak computing power – around four times the powe Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Quantum Workforce – NSTC Report Highlights Need for International Talent

October 13, 2021

Attracting and training the needed quantum workforce to fuel the ongoing quantum information sciences (QIS) revolution is a hot topic these days. Last week, the U.S. National Science and Technology Council issued a report – The Role of International Talent in Quantum Information Science... Read more…

Eni Returns to HPE for ‘HPC4’ Refresh via GreenLake

October 13, 2021

Italian energy company Eni is upgrading its HPC4 system with new gear from HPE that will be installed in Eni’s Green Data Center in Ferrera Erbognone (a provi Read more…

The Blueprint for the National Strategic Computing Reserve

October 12, 2021

Over the last year, the HPC community has been buzzing with the possibility of a National Strategic Computing Reserve (NSCR). An in-utero brainchild of the COVID-19 High-Performance Computing Consortium, an NSCR would serve as a Merchant Marine for urgent computing... Read more…

UCLA Researchers Report Largest Chiplet Design and Early Prototyping

October 12, 2021

What’s the best path forward for large-scale chip/system integration? Good question. Cerebras has set a high bar with its wafer scale engine 2 (WSE-2); it has 2.6 trillion transistors, including 850,000 cores, and was fabricated using TSMC’s 7nm process on a roughly 8” x 8” silicon footprint. Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

US Closes in on Exascale: Frontier Installation Is Underway

September 29, 2021

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, held by Zoom this week (Sept. 29-30), it was revealed that the Frontier supercomputer is currently being installed at Oak Ridge National Laboratory in Oak Ridge, Tenn. The staff at the Oak Ridge Leadership... Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer... Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

AMD-Xilinx Deal Gains UK, EU Approvals — China’s Decision Still Pending

July 1, 2021

AMD’s planned acquisition of FPGA maker Xilinx is now in the hands of Chinese regulators after needed antitrust approvals for the $35 billion deal were receiv Read more…

Leading Solution Providers

Contributors

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Quantum Roundup: IBM, Rigetti, Phasecraft, Oxford QC, China, and More

July 13, 2021

IBM yesterday announced a proof for a quantum ML algorithm. A week ago, it unveiled a new topology for its quantum processors. Last Friday, the Technical Univer Read more…

The Latest MLPerf Inference Results: Nvidia GPUs Hold Sway but Here Come CPUs and Intel

September 22, 2021

The latest round of MLPerf inference benchmark (v 1.1) results was released today and Nvidia again dominated, sweeping the top spots in the closed (apples-to-ap Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Unveils New Node Names; Sapphire Rapids Is Now an ‘Intel 7’ CPU

July 27, 2021

What's a preeminent chip company to do when its process node technology lags the competition by (roughly) one generation, but outmoded naming conventions make i Read more…

Frontier to Meet 20MW Exascale Power Target Set by DARPA in 2008

July 14, 2021

After more than a decade of planning, the United States’ first exascale computer, Frontier, is set to arrive at Oak Ridge National Laboratory (ORNL) later this year. Crossing this “1,000x” horizon required overcoming four major challenges: power demand, reliability, extreme parallelism and data movement. Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire