Doug Kothe Delivers Whirlwind ECP Update in 70 (or so) Slides

By John Russell

May 2, 2019

So much attention is given to forthcoming exascale hardware – Aurora is scheduled to be the first U.S. exascale system to go live around 2021/22 – that the U.S. Exascale Computing Project’s (ECP) work to develop a robust software ecosystem to coax the most from these exascale machines often gets short shrift. That’s too bad because in many ways there is more to talk about with regard to ECP which has already released many ‘products’.

Doug Kothe, ECP director

On Tuesday, Doug Kothe, midway through his second year as ECP director, provided a high-speed tour of ECP progress in a livestreamed talk for ACM. Officially entitled, The Exascale Computing Project and the Future of HPC, Kothe quipped at the start, “I’ll leave it to the audience to ascertain the future of HPC [and] do my best to get through the depth and breadth of what we’ve been up to.” Good choice. There’s too much to cover.

Quick backgrounder: ECP, you may know, was formed in 2016 as part of the overall U.S. Exascale Computing Initiative being run by DoE. The ECI, among other things, procures the exascale systems. ECPs charge is to ensure there’s an exascale-ready software ecosystem to get the most from exascale hardware when it arrives. You may not know ECP has finite lifetime and is scheduled to end in 2023. Kothe calls ECP a seven-year sprint.

Organizationally, ECP is overseen by a board of directors chaired by Bill Goldstein, director of Lawrence Livermore National Laboratory, and vice chair Thomas Zacharia, director of Oak Ridge National Laboratory. There is also an ECP Industry Council led by General Electric which weighs in on functional requirements and acts in an advisory capacity but has no formal review authority. Kothe notes that perhaps unlike past DoE efforts, ECP is trying to produce hardened, production quality software which is released regularly and that ECP has firm milestones and to keep it on track.

 

 

 

 

Much of Kothe’s presentation is likely familiar to close watchers of ECP; nevertheless, the scope of ECP activities presented along with pointers to sources for more material was impressive. It was almost too much but as an ECP resource the ACM recording and slide deck is a keeper if you can get it. ECP communication lead Mike Bernhardt says DoE is reviewing the talk now before publicly releasing it but that should happen soon (update: recording  plus slides now available).

Kothe zipped through about 70 slides in under an hour. He made clear throughout his presentation that ECP’s various goals specifically supporting DoE missions are matched by the expectation that ECP developed technologies will also find broad use within HPC. It turns out ECP has already been busy churning out applications, SDKs, contributions to open source, and an extreme scale software stack.

It’s probably worth restating what constitutes DoE’s definition of ‘capable exascale’ for the new systems since that’s the official goal. Broadly, ECI calls for at least two diverse system architectures. Each should deliver 50x the performance of today’s 20 petaflop systems and 5x the performance of Summit. The systems should function with sufficient resiliency (an average fault rate of ≤1 per week) and include a software stack that meets the needs of a broad spectrum of applications and workloads.

Presented here are just a few of Kothe’s slides (click to enlarge) and his accompanying comments.

There are six application target areas (shown below) which were selected in 2016 in conjunction with DoE sponsors. Each application (~20) addresses a strategic problem of interest to a program office. Kothe said, “It wasn’t easy to downselect to those” and also emphasized ECP “is not waiting for exascale systems [to arrive] but working hard on the current systems (e.g. Summit, Sierra).” So far, he said, performance is exceeding expectations.

 

 

 

Co-design, of course, has been a key component from ECP’s start. One area being focused on is motifs. “Typically each application has a small set of motifs, a common pattern of computation. We we’ve chosen in terms of co-design to go after motifs and really see if we can make those motifs perform well on the exascale and pre-exascale systems. Here (below) you see the list of six co-design centers and a proxy application [center],” said Kothe. “[They have] all have proven their worth with regard to developing, not just best practices and lessons learned, but libraries and components that we view as sort of next generation middleware that many applications will use.”

 

 

Interestingly, one of the co-design efforts is not motif-focused. It’s the Co-Design Center for Online Data Analysis and Reduction (CODAR) working on approaches to workflow management and data analysis.

“Here (below) you see the traditional approach. An ap runs and dumps its data and another ap runs and picks it up and does the analysis. We really can’t afford to do that. There is a disparity in the hardware in terms of I/O bandwidth relative to the memory bandwidth. We really want to be able to do online reduction. In other words the application runs, and we’re doing of reduction of data as it runs, and process the data as it runs, and that analysis may be passive or active back on the application. We may [sometimes] need a couple applications running on the hardware at the same time that may need to talk back and forth in some sort of consistent way,” he said.

“This center is essentially releasing an entire workflow management system that a number of applications [in areas such as] fusion, material science, molecular dynamics, and climate, are looking at to leverage,” said Kothe.

 

 

Not surprisingly, ECP, like many  in HPC, is scrambling to dive into machine learning. The ExaLearn center was created just last fall.

“There are several use cases of interest to ECP. Obviously we’ll be interested in picking industry frameworks wherever we can. So the goal isn’t to recreate good technologies like Tensorflow that are out there. In particular we are interested in surrogate models for uncertainty quantification and error estimation, control systems, and inverse problems. A good [use case] example for machine learning is looking at our experimental facilities. Here’s a light source, (slide below) and I think there are at least five [similar light sources] in the labs,” said Kothe.

“These are multi-million-dollar facilities that are getting great experimental return but we think we can help even more with everything [from] up-stream design of the light source, controlling the beam lines in real-time, to interfacing with the data acquisition system to help understand the data real-time [and] being able to do fast analysis onsite, and ultimately sending data to the exascale system. This is potentially a high return area.”

 

 

Clearly developing a wide range of software technology – tools and the stack – is a key imperative for ECP. “The philosophy here is to be prudent and extend current technologies where possible, build a comprehensive software stack, but leverage frankly the hundreds of man-years of that investment that we have,” said Kothe.

In delivering these capabilities Kothe said the emphasis is on delivering high quality, production software – “probably something we haven’t done well in DoE in the past”. Convenient delivery of these tools is also important, “recognizing we can encapsulate these products into a smaller set of development kits that have kind of like products packages that are containerized.” ECP currently supports Docker, Charliecloud, Singularity, and Shifter container technology.

 

Performance milestones are also part of ECP delivery requirements and Kothe points to work with Hypre to leverage mixed precision computation as an example: “We were investigating going from 64-bit to 32-bit integer trying to take advantage of the accelerated hardware. In this case we gained about a 25 percent performance increase just by investigating where can we go to lower precision and still do the job. I just want to point out we are a project with milestones kind of every three or four months and this is a good example of a hypre milestone.”

 

On balance Kothe’s talk and slides present a reasonably full picture of the scope of ECP activities. HPCwire will provide a link to those resources when they become available. Stay tuned. (update: link to recording and slides now available)

Link to recording: https://event.on24.com/eventRegistration/console/EventConsoleApollo.jsp?&eventid=1982470&sessionid=1&username=&partnerref=&format=fhvideo1&mobile=false&flashsupportedmobiledevice=false&helpcenter=false&key=810AC9D28D7C7F9885FBA59DACE69F85&text_language_id=en&playerwidth=1000&playerheight=650&overwritelobby=y&eventuserid=237553032&contenttype=A&mediametricsessionid=197265780&mediametricid=2793966&usercd=237553032&mode=launch

Link to slides: https://on24static.akamaized.net/event/19/82/47/0/rt/1/documents/resourceList1556627172809/dougkotheexascaletechtalkslides1556627165263.pdf

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Watch Nvidia’s GTC21 Keynote with Jensen Huang Livestreamed Here at 8:30 am PT Today

April 12, 2021

Join HPCwire right here on Monday, April 12, at 8:30 am PT to see the Nvidia GTC21 keynote from Nvidia’s CEO, Jensen Huang, livestreamed in its entirety. Hosted by HPCwire, you can click to join the Huang keynote on our livestream to hear Nvidia’s expected news and... Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U.S. Entity List bars U.S. firms from supplying key technolog Read more…

Argonne Supercomputing Supports Caterpillar Engine Design

April 8, 2021

Diesel fuels still account for nearly ten percent of all energy-related U.S. carbon emissions – most of them from heavy-duty vehicles like trucks and construction equipment. Energy efficiency is key to these machines, Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new training and inference servers that will power the upcoming Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

AWS Solution Channel

Volkswagen Passenger Cars Uses NICE DCV for High-Performance 3D Remote Visualization

 

Volkswagen Passenger Cars has been one of the world’s largest car manufacturers for over 70 years. The company delivers more than 6 million automobiles to global customers every year, from 50 production locations on five continents. Read more…

What’s New in HPC Research: Tundra, Fugaku, µHPC & More

April 6, 2021

In this regular feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

Watch Nvidia’s GTC21 Keynote with Jensen Huang Livestreamed Here at 8:30 am PT Today

April 12, 2021

Join HPCwire right here on Monday, April 12, at 8:30 am PT to see the Nvidia GTC21 keynote from Nvidia’s CEO, Jensen Huang, livestreamed in its entirety. Hosted by HPCwire, you can click to join the Huang keynote on our livestream to hear Nvidia’s expected news and... Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

RIKEN’s Ongoing COVID Research Includes New Vaccines, New Tests & More

April 6, 2021

RIKEN took the supercomputing world by storm last summer when it launched Fugaku – which became (and remains) the world’s most powerful supercomputer – ne Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2021) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

Microsoft, HPE Bringing AI, Edge, Cloud to Earth Orbit in Preparation for Mars Missions

February 12, 2021

The International Space Station will soon get a delivery of powerful AI, edge and cloud computing tools from HPE and Microsoft Azure to expand technology experi Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire