HPE, AMD and EuroHPC Partner for Pre-Exascale LUMI Supercomputer

By Oliver Peckham

October 21, 2020

Not even a week after Nvidia announced that it would be providing hardware for the first four of the eight planned EuroHPC systems, HPE and AMD are announcing another major EuroHPC design win. Finnish supercomputing center CSC revealed today that its forthcoming LUMI system – commissioned under the auspices of EuroHPC – will be built by HPE using AMD processor technology. With a target Linpack performance of 375 petaflops, LUMI is the second of three planned “pre-exascale” machines under EuroHPC to have its hardware detailed. The system also breaks new ground in energy efficiency.

The system

LUMI is based on the HPE Cray EX supercomputer architecture, and will harness next-generation AMD Epyc CPUs and AMD Instinct GPUs. Storage will include 7 PB of accelerated flash-based storage (LUMI-F, utilizing a Cray ClusterStor E1000 storage system); an 80 PB Lustre file system (LUMI-P); and 30 PB of encrypted object storage (LUMI-O). LUMI’s primary GPU-driven partition (LUMI-G) will be supplemented by a data analytics partition with 32 TB of memory and additional GPUs (LUMI-D), as well as a CPU partition featuring around 200,000 AMD Epyc CPU cores. LUMI will use HPE Slingshot networking.

LUMI’s main partition is expected to deliver over 550 peak petaflops of computing power, just above (current Top500 leader) Fugaku’s 513.8 peak petaflops. Committed Linpack performance, meanwhile, is 375 petaflops (shy of Fugaku’s 415.5). This makes LUMI the most powerful of the five planned EuroHPC systems that have been detailed so far: Italy’s Leonardo system is expected to deliver over 200 peak petaflops; Luxembourg’s Meluxina, over 18; the Czech Republic’s EURO IT4I, 15.2; and Slovenia’s Vega, 6.8.

Energy efficiency & siting

LUMI will support research from ten countries, comprising a new “LUMI consortium”: Belgium, the Czech Republic, Denmark, Estonia, Finland, Iceland, Norway, Poland, Sweden and Switzerland. The consortium says that LUMI will enable more precise climate models; advanced AI applications in areas like self-driving vehicle development; large-scale social science analytics; personalized medicine research; and much more. Up to 20 percent of LUMI’s capacity will be reserved for European industry and small- and medium-sized enterprises (SMEs).

The planned design for the LUMI datacenter. Image courtesy of Synposis Architects Ltd. and Geometria Architecture Ltd.

The system will be installed in a new datacenter at CSC’s campus in Kajaani, Finland, where CSC says the system will take up roughly the size of a tennis court. The datacenter is expected to be ready by Q4 2020; the first phase of LUMI, by Q2 2021; and the second phase of LUMI, by Q4 2021. LUMI will use 100 percent renewable energy (thanks to local hydropower) and its waste heat will be used to supply approximately 20 percent of the yearly district heating needs of its host town, resulting in a stated net negative carbon footprint of 13,500 tons of CO2 equivalent per year.

HPE says that LUMI will use “approximately 8.5 megawatts,” which translates into an extremely efficient 44.1 gigaflops per watt. For context, this is nearly double the efficiency of the current Green500 leader, MN-3, which delivers 21.1 gigaflops per watt. Extrapolating LUMI’s numbers out, an exascale system would require just around 22.7 megawatts — well within the 40-megawatt limit targeted by the planned U.S. exascale systems (a goal that requires a minimum efficiency of 25 gigaflops per watt), and close to the ambitious 20-megawatt exascale goal set by the U.S. Defense Advanced Research Project Agency (DARPA) in the early 2010s. With HPE supplying those three exascale systems as well, this may be the first real preview of those systems’ computational efficiency.

“Once operational in mid-2021, the LUMI supercomputer will be one of the most competitive and green supercomputers in the world,” said Anders Jensen, executive director of EuroHPC. “Such [a] leadership-class system will support European researchers, industry and [the] public sector in better understanding and responding to complex challenges and transforming them into innovation opportunities in sectors like health, weather forecasting or urban and rural planning.”

LUMI’s total cost of ownership through 2026 is expected to be approximately €200 million ($237.1 million), of which €140 million ($165 million) will go toward the supercomputer itself. This cost will be split between the European Commission (€100 million), Finland (€50 million) and the remaining nine countries in the LUMI consortium (€50 million).  

The EuroHPC roadmap

LUMI is the second EuroHPC system so far that is being built by HPE (with the other being EURO IT4I). Leonardo, Meluxina and Vega, meanwhile, are all being built by French IT firm Atos. As a U.S. company, HPE appears to have successfully wooed EuroHPC with promises to bring some of its operations across the pond: HPE will be manufacturing liquid-cooled Cray EX supercomputers and Apollo systems in its Kutná Hora factory in the Czech Republic (where EURO IT4I will be based), and the company has also committed to establishing a Center of Excellence in Europe that will provide R&D services and expertise in support of exascale readiness.

Three of the eight planned EuroHPC systems are yet to be detailed:  the four-petaflops PetaSC system, hosted by Sofia Tech Park in Bulgaria; the ten-petaflops Deucalion system, hosted by the Minho Advanced Computing Center in Portugal; and the 200-petaflops MareNostrum 5 system, hosted by the Barcelona Supercomputing Center in Spain. By process of elimination, MareNostrum 5 will be the last of the three pre-exascale systems to be fully announced. “For the third machine, the tendering process is in its very final phase now,” Jensen said, “so there will be announcements on that in the coming weeks.”

LUMI is the latest in a series of wins for HPE’s Cray EX systems, which will serve as the basis for the three planned U.S. exascale systems (Aurora, El Capitan and Frontier) and Australia’s most powerful supercomputer (just announced this week). Conspicuously absent, however, are mentions of the European Processor Initiative (EPI) and its planned first-generation “Rhea” CPUs, ostensibly slated for 2021. Jensen maintains that the EPI continues to factor into the future of EuroHPC.

“The ambition is that when we get to the exascale systems – which is what we will be discussing in the coming years – … that EPI will deliver a processor that we can base at least one of the upcoming exascale systems on,” he said.

Header image: concept art of the LUMI supercomputer. Image courtesy of CSC. 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Exascale Climate Model Used to Examine the Climate Consequences of Nuclear War

December 3, 2020

Often, we can tend to examine global crises in isolation – however, they can have surprising feedback effects on one another. The COVID-19 pandemic, for instance, has led to a small global decrease in emissions, and cl Read more…

By Oliver Peckham

Natural Compounds, Identified via HPC, Move Forward in COVID-19 Therapeutic Testing

December 2, 2020

Nearly six months ago, HPCwire reported on efforts by researchers at the University of Alabama in Huntsville (UAH) to identify natural compounds that could be useful in the fight against COVID-19. At the time, the resear Read more…

By Oliver Peckham

AWS Reveals Gaudi-based EC2 Instances Coming in 2021

December 2, 2020

Amazon Web Services has a broad swath of new and bolstered services coming for customers in 2021, from the implementation of powerful Habana Gaudi AI hardware in Amazon EC2 instances for machine learning workloads to cus Read more…

By Todd R. Weiss

AWS Goes Supersonic with Boom

December 2, 2020

Supersonic flights are a Holy Grail of commercial aviation, promising halvings of international flight times. While commercial supersonic flights have operated in the past, high costs for both airlines and passengers led Read more…

By Oliver Peckham

VAST Data Makes the Case for All-Flash Storage; Do you Agree?

December 1, 2020

Founded in 2016, all-flash storage startup VAST Data says it is on the verge of upending storage practices in line with its original mission which was and remains “to kill the hard drive,” says Jeff Denworth, one of Read more…

By John Russell

AWS Solution Channel

Add storage to your high-performance file system with a single click and meet your scalability needs

Many organizations have on-premises, high-performance workloads burdened with complex management and scalability challenges. Scaling data-intensive workloads on-premises typically involves purchasing more hardware, which can slow time to production and require high upfront investment. Read more…

Intel® HPC + AI Pavilion

Intel Keynote Address

Intel is the foundation of HPC – from the workstation to the cloud to the backbone of the Top500. At SC20, Intel’s Trish Damkroger, VP and GM of high performance computing, addresses the audience to show how Intel and its partners are building the future of HPC today, through hardware and software technologies that accelerate the broad deployment of advanced HPC systems. Read more…

HPC Career Notes: December 2020 Edition

December 1, 2020

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it’s a promotion, new company hire, or even an accolade, we’ Read more…

By Mariana Iriarte

AWS Reveals Gaudi-based EC2 Instances Coming in 2021

December 2, 2020

Amazon Web Services has a broad swath of new and bolstered services coming for customers in 2021, from the implementation of powerful Habana Gaudi AI hardware i Read more…

By Todd R. Weiss

AWS Goes Supersonic with Boom

December 2, 2020

Supersonic flights are a Holy Grail of commercial aviation, promising halvings of international flight times. While commercial supersonic flights have operated Read more…

By Oliver Peckham

VAST Data Makes the Case for All-Flash Storage; Do you Agree?

December 1, 2020

Founded in 2016, all-flash storage startup VAST Data says it is on the verge of upending storage practices in line with its original mission which was and remai Read more…

By John Russell

HPC Career Notes: December 2020 Edition

December 1, 2020

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it Read more…

By Mariana Iriarte

The Present and Future of AI: A Discussion with HPC Visionary Dr. Eng Lim Goh

November 27, 2020

As HPE’s chief technology officer for artificial intelligence, Dr. Eng Lim Goh devotes much of his time talking and consulting with enterprise customers about Read more…

By Todd R. Weiss

SC20 Panel – OK, You Hate Storage Tiering. What’s Next Then?

November 25, 2020

Tiering in HPC storage has a bad rep. No one likes it. It complicates things and slows I/O. At least one storage technology newcomer – VAST Data – advocates dumping the whole idea. One large-scale user, NERSC storage architect Glenn Lockwood sort of agrees. The challenge, of course, is that tiering... Read more…

By John Russell

Exscalate4CoV Runs 70 Billion-Molecule Coronavirus Simulation

November 25, 2020

The winds of the pandemic are changing – for better and for worse. Three viable vaccines now teeter on the brink of regulatory approval, which will pave the way for broad distribution by April or May. But until then, COVID-19 cases are skyrocketing across the U.S. and Europe... Read more…

By Oliver Peckham

Azure Scaled to Record 86,400 Cores for Molecular Dynamics

November 20, 2020

A new record for HPC scaling on the public cloud has been achieved on Microsoft Azure. Led by Dr. Jer-Ming Chia, the cloud provider partnered with the Beckman I Read more…

By Oliver Peckham

Azure Scaled to Record 86,400 Cores for Molecular Dynamics

November 20, 2020

A new record for HPC scaling on the public cloud has been achieved on Microsoft Azure. Led by Dr. Jer-Ming Chia, the cloud provider partnered with the Beckman I Read more…

By Oliver Peckham

Supercomputer-Powered Research Uncovers Signs of ‘Bradykinin Storm’ That May Explain COVID-19 Symptoms

July 28, 2020

Doctors and medical researchers have struggled to pinpoint – let alone explain – the deluge of symptoms induced by COVID-19 infections in patients, and what Read more…

By Oliver Peckham

Google Hires Longtime Intel Exec Bill Magro to Lead HPC Strategy

September 18, 2020

In a sign of the times, another prominent HPCer has made a move to a hyperscaler. Longtime Intel executive Bill Magro joined Google as chief technologist for hi Read more…

By Tiffany Trader

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated Read more…

By George Leopold

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Is the Nvidia A100 GPU Performance Worth a Hardware Upgrade?

October 16, 2020

Over the last decade, accelerators have seen an increasing rate of adoption in high-performance computing (HPC) platforms, and in the June 2020 Top500 list, eig Read more…

By Hartwig Anzt, Ahmad Abdelfattah and Jack Dongarra

NICS Unleashes ‘Kraken’ Supercomputer

April 4, 2008

A Cray XT4 supercomputer, dubbed Kraken, is scheduled to come online in mid-summer at the National Institute for Computational Sciences (NICS). The soon-to-be petascale system, and the resulting NICS organization, are the result of an NSF Track II award of $65 million to the University of Tennessee and its partners to provide next-generation supercomputing for the nation's science community. Read more…

Aurora’s Troubles Move Frontier into Pole Exascale Position

October 1, 2020

Intel’s 7nm node delay has raised questions about the status of the Aurora supercomputer that was scheduled to be stood up at Argonne National Laboratory next year. Aurora was in the running to be the United States’ first exascale supercomputer although it was on a contemporaneous timeline with... Read more…

By Tiffany Trader

Leading Solution Providers

Contributors

European Commission Declares €8 Billion Investment in Supercomputing

September 18, 2020

Just under two years ago, the European Commission formalized the EuroHPC Joint Undertaking (JU): a concerted HPC effort (comprising 32 participating states at c Read more…

By Oliver Peckham

HPE Keeps Cray Brand Promise, Reveals HPE Cray Supercomputing Line

August 4, 2020

The HPC community, ever-affectionate toward Cray and its eponymous founder, can breathe a (virtual) sigh of relief. The Cray brand will live on, encompassing th Read more…

By Tiffany Trader

Top500: Fugaku Keeps Crown, Nvidia’s Selene Climbs to #5

November 16, 2020

With the publication of the 56th Top500 list today from SC20's virtual proceedings, Japan's Fugaku supercomputer – now fully deployed – notches another win, Read more…

By Tiffany Trader

Texas A&M Announces Flagship ‘Grace’ Supercomputer

November 9, 2020

Texas A&M University has announced its next flagship system: Grace. The new supercomputer, named for legendary programming pioneer Grace Hopper, is replacing the Ada system (itself named for mathematician Ada Lovelace) as the primary workhorse for Texas A&M’s High Performance Research Computing (HPRC). Read more…

By Oliver Peckham

At Oak Ridge, ‘End of Life’ Sometimes Isn’t

October 31, 2020

Sometimes, the old dog actually does go live on a farm. HPC systems are often cursed with short lifespans, as they are continually supplanted by the latest and Read more…

By Oliver Peckham

Microsoft Azure Adds A100 GPU Instances for ‘Supercomputer-Class AI’ in the Cloud

August 19, 2020

Microsoft Azure continues to infuse its cloud platform with HPC- and AI-directed technologies. Today the cloud services purveyor announced a new virtual machine Read more…

By Tiffany Trader

Nvidia and EuroHPC Team for Four Supercomputers, Including Massive ‘Leonardo’ System

October 15, 2020

The EuroHPC Joint Undertaking (JU) serves as Europe’s concerted supercomputing play, currently comprising 32 member states and billions of euros in funding. I Read more…

By Oliver Peckham

Nvidia-Arm Deal a Boon for RISC-V?

October 26, 2020

The $40 billion blockbuster acquisition deal that will bring chipmaker Arm into the Nvidia corporate family could provide a boost for the competing RISC-V architecture. As regulators in the U.S., China and the European Union begin scrutinizing the impact of the blockbuster deal on semiconductor industry competition and innovation, the deal has at the very least... Read more…

By George Leopold

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This