Meet the Exascale Apps

By Gary Johnson

April 12, 2012

In what will be a three-decade span between gigascale and exascale computing, HPC capability will have increased by a factor of one billion, but the apps that are projected to use this enormous increase in capability look pretty much like the gigascale ones. Are we missing opportunities as we push the apex of HPC higher?

Gigascale to Terascale

In February of 1991, the Office of Science and Technology Policy released the first “Blue Book” supplement to the President’s FY 1992 Budget Request for the new High Performance Computing and Communications Program. It was entitled “Grand Challenges: High Performance Computing and Communications” and contained a listing of the computational science and engineering challenges then seen as drivers for federal expenditures on HPC. Figure 2 from that report is reproduced below.

 Petascale to Exascale

In preparation for the current attempt to secure federal funding for exascale computing, the Department of Energy conducted a series of workshops entitled “Scientific Grand Challenges Workshop Series”. While this series only focused on science and engineering areas of importance to DOE’s mission, that mission is broad enough to view the grand challenges discussed there as typical of the applications areas foreseen as drivers for the move to exascale.

With the use of a bit of poetic license to prevent the reader’s eyes from glazing over, the table below attempts to convey the general character to these early 1990s gigascale to terascale applications and the exascale applications considered for the 2018-2025 timeframe (depending on whose guess about the arrival of exascale computing one chooses).

We see that over a span of 28 to 35 years, depending on how you count, the applications list remains substantially the same. A few of the 90s applications have dropped off the list – either through success or loss of interest. A couple of well-established applications: Nuclear Physics and Nuclear Energy Systems have been added in response to renewed interest in nuclear energy. To be sure, the other areas listed – the ones surviving multiple decades – have grown in complexity and broadened in applicability. What seems to be missing is the addition of any fundamentally new applications.

Over the decades since the publication of that first Blue Book, “apexscale” HPC has grown in capability by a factor of 1,000,000. In another decade, when exascale machines occupy the apex, they will be a factor of 1,000,000,000 more capable than those early 90s machines. Certainly, this enormous increase must present the opportunity to do a few fundamentally new things.

Capability Computing Usage Modes

In general, as HPC grows in capability, it can be used in three distinct ways:

  • Do what we’re currently doing, but faster or cheaper;
  • Undertake the logical extension of what we’re currently doing to use additional computing capabilities; or
  • Use the new and vastly more capable resource to do something we hadn’t seriously considered trying before.

Clearly and justifiably, we are using apexscale HPC in the first two ways. But what about the third? Have we run out of new ideas? Certainly not. But getting new apps on the agenda seems to have been either remarkably hard or of surprisingly little interest.

Exascale Readiness

Whether any new application candidate is, from inception, “exascale ready” seems considerably less important than its potential scalability. We are, after all, living in an age of scalable computing. Observe that many of the gigascale apps of the early 90s have readily survived, and thrived on, the transition to petascale and (soon) exascale. Did we coincidentally choose the complete collection of applications with this sort of potential for scalability back then or could there be others lurking in the wings?

Opportunities

Thinking of what we hadn’t thought of is always difficult and fraught with peril (you don’t know what you don’t know). However, the commercial and open science worlds have provided us with a few possibilities.

Big Data

Although several federally-funded applications areas have well-established needs for data crunching (e.g., high-energy physics, bioinformatics, and national security), the current opportunity in “Big Data” comes from the commercial world. Think: Social Data Analysis, Personal Analytics, Biobank, the Quantified Self, 23andMe, Healthrageous, Integrated Personal Omics, MyLifeBits. These are probably just the tip of the big data iceberg.

IBM has already launched Watson, with (beyond Jeopardy) foci on health care and financial services. Cray and Sandia National Laboratories have started a Supercomputing Institute for Learning and Knowledge Systems. NeuStar and the University of Illinois Urbana-Champaign have created a Big Data Research Facility. The federal government is also getting onboard with its recently announced Big Data Initiative. In fact, it’s interesting to note that the “Blue Book” accompanying the President’s FY 2013 budget request is strongly focused on big data and not the grand challenges of earlier blue books.

So, Big Data is probably a “no brainer” for the new applications category. Some of it may not be exascale yet, but there’s lots of room to grow.

Brain in a Box

This new application candidate has been advocated by Henry Markram at the Swiss Federal Institute of Technology in Lausanne (EFPL). Its official title is the Human Brain Project (HBP).

As described in a recent Nature article, it’s “an effort to build a supercomputer simulation that integrates everything known about the human brain, from the structures of ion channels in neural cell membranes up to mechanisms behind conscious decision-making.” Markram’s precursor Blue Brain Project at EFPL estimates that this is an exascale application (see figure below).

IBM is also a player in the activity, with its cognitive computing project called Systems of Neuromorphic Adaptive Plastic Scalable Electronics (SyNAPSE). This project claims that “By reproducing the structure and architecture of the brain—the way its elements receive sensory input, connect to each other, adapt these connections, and transmit motor output—the SyNAPSE project models computing systems that emulate the brain’s computing efficiency, size and power usage without being programmed.”

Thus, some form of simulation of the complete human brain seems like a keeper for our new applications short list.

Global-scale Systems

Under this heading, a couple of systems immediately come to mind: the global energy system and the global social system. Each seems worthy of a modeling effort.

In this vein, the European Commission has recently funded a “Big Science” pilot project, called FutureICT, “to understand and manage complex, global, socially interactive systems, with a focus on sustainability and resilience.” FutureICT intends to accomplish these goals “by developing new scientific approaches and combining these with the best established methods in areas like multi-scale computer modeling, social supercomputing, large-scale data mining and participatory platforms.” Sounds like there’s potential for an exascale application here.

To the best of our knowledge, there is no current effort to simulate the complete global energy system. However, given the critical nature of energy, from resource discovery and recovery, through transportation of energy materials, to production and distribution of energy, and disposition of by-products, it seems like having one or more full-scale, high- fidelity simulation tools on hand might be a good idea. Perhaps this will be part of the FutureICT project.

The Whole Planet

Thanks to a concerted international effort spanning a couple of decades, we now have some pretty good global climate models. This community effort has also set a shining example for “team science.”

Lately, the climate modeling community has begun using the term “Earth systems science,” as more phenomenology is added to the basic coupled ocean-atmosphere simulations. Laudable and valuable as these efforts may be, they still leave most of the planet out of the models. So, maybe we should model the whole planet.

The opportunity for such a whole planet model is made visible when one looks at the imagery of our Blue Marble. One immediately notices how thin the shell of the atmosphere is in comparison to the dimensions of our planet. The Earth’s volumetric mean radius is 6371 km. Current climate models reach about 30 km above the surface. The deepest point any ocean model needs to reach is about 12 km below the surface. So, our current modeling efforts are focused on a shell that is, at best, about 0.66 percent of the Earth’s radius. This shell represents about 1.96 percent of the Earth’s volume and 0.02 percent of its mass.

Note that the sort of whole planet model proposed here represents an extreme example of a multi-physics, multi-scale problem. The relevant temporal and spatial scales range from sub-millisecond molecular interactions to multi-millennia ice sheet models to million cubic kilometer modeling of the ionosphere.

The advantages of a fully integrated whole planet model are readily apparent and include applications for:

  • Disaster management and mitigation
  • Energy exploitation
  • Minerals exploration and recovery
  • Siting of critical facilities (e.g., nuclear power plants and waste repositories)
  • Understanding the impact of climate change on built infrastructure
  • Understanding the interactions among human, ecological and physical systems

The availability of such models would also serve to advance fundamental scientific understanding of our planet and its dynamics. Furthermore, undertaking to build such models would provide researchers in all of the relevant disciplines with a clear context for thinking about their research activities and how they contribute to the overall planet modeling effort.

Since the earth system models already in development will require trans-petascale computing capabilities, it is clear that exascale capability will be a bare minimum requirement for whole planet models.

The idea of building the sort of top-down whole planet model suggested here has also occurred to others. See, for example, the agenda of the Geneva-based International Centre for Earth Simulation (ICES). Furthermore, no discussion of this topic would be complete without paying homage to the ground-breaking efforts of Japan’s Earth Simulator Center.

Thinking outside the box

Making the case for new applications is a game that anyone can play. Here we have attempted to make the point that there may be worthwhile candidates lurking out there, beyond the view of our current exascale effort and its list of drivers.

If you don’t like these examples, please feel free to critique and improve them. If you have additional applications candidates, please make them known. The more frank and constructive discussion we have on this topic, the better and richer the future of HPC will be.

About the author

Gary M. Johnson is the founder of Computational Science Solutions, LLC, whose mission is to develop, advocate, and implement solutions for the global computational science and engineering community.

Dr. Johnson specializes in management of high performance computing, applied mathematics, and computational science research activities; advocacy, development, and management of high performance computing centers; development of national science and technology policy; and creation of education and research programs in computational engineering and science.

He has worked in Academia, Industry and Government. He has held full professorships at Colorado State University and George Mason University, been a researcher at United Technologies Research Center, and worked for the Department of Defense, NASA, and the Department of Energy.

He is a graduate of the U.S. Air Force Academy; holds advanced degrees from Caltech and the von Karman Institute; and has a Ph.D. in applied sciences from the University of Brussels.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

China’s Expanding Effort to Win in Microchips

July 27, 2017

The global battle for preeminence, or at least national independence, in semiconductor technology and manufacturing continues to heat up with Europe, China, Japan, and the U.S. all vying for sway. A fascinating article ( Read more…

By John Russell

Hyperion: Storage to Lead HPC Growth in 2016-2021

July 27, 2017

Global HPC external storage revenues will grow 7.8% over the 2016-2021 timeframe according to an updated forecast released by Hyperion Research this week. HPC server sales, by comparison, will grow a modest 5.8% to $14.8 Read more…

By John Russell

Exascale FY18 Budget – The Senate Provides Their Input

July 27, 2017

In the federal budgeting world, “regular order” is a meaningful term that is fondly remembered by members of both the Congress and the Executive Branch. Regular order is the established process whereby an Administrat Read more…

By Alex R. Larzelere

HPE Extreme Performance Solutions

HPE Servers Deliver High Performance Remote Visualization

Whether generating seismic simulations, locating new productive oil reservoirs, or constructing complex models of the earth’s subsurface, energy, oil, and gas (EO&G) is a highly data-driven industry. Read more…

India Plots Three-Phase Indigenous Supercomputing Strategy

July 26, 2017

Additional details on India's plans to stand up an indigenous supercomputer came to light earlier this week. As reported in the Indian press, the Rs 4,500-crore (~$675 million) supercomputing project, approved by the Ind Read more…

By Tiffany Trader

Exascale FY18 Budget – The Senate Provides Their Input

July 27, 2017

In the federal budgeting world, “regular order” is a meaningful term that is fondly remembered by members of both the Congress and the Executive Branch. Reg Read more…

By Alex R. Larzelere

India Plots Three-Phase Indigenous Supercomputing Strategy

July 26, 2017

Additional details on India's plans to stand up an indigenous supercomputer came to light earlier this week. As reported in the Indian press, the Rs 4,500-crore Read more…

By Tiffany Trader

Tuning InfiniBand Interconnects Using Congestion Control

July 26, 2017

InfiniBand is among the most common and well-known cluster interconnect technologies. However, the complexities of an InfiniBand (IB) network can frustrate the Read more…

By Adam Dorsey

NSF Project Sets Up First Machine Learning Cyberinfrastructure – CHASE-CI

July 25, 2017

Earlier this month, the National Science Foundation issued a $1 million grant to Larry Smarr, director of Calit2, and a group of his colleagues to create a comm Read more…

By John Russell

Graphcore Readies Launch of 16nm Colossus-IPU Chip

July 20, 2017

A second $30 million funding round for U.K. AI chip developer Graphcore sets up the company to go to market with its “intelligent processing unit” (IPU) in Read more…

By Tiffany Trader

Fujitsu Continues HPC, AI Push

July 19, 2017

Summer is well under way, but the so-called summertime slowdown, linked with hot temperatures and longer vacations, does not seem to have impacted Fujitsu's out Read more…

By Tiffany Trader

Researchers Use DNA to Store and Retrieve Digital Movie

July 18, 2017

From abacus to pencil and paper to semiconductor chips, the technology of computing has always been an ever-changing target. The human brain is probably the com Read more…

By John Russell

The Exascale FY18 Budget – The Next Step

July 17, 2017

On July 12, 2017, the U.S. federal budget for its Exascale Computing Initiative (ECI) took its next step forward. On that day, the full Appropriations Committee Read more…

By Alex R. Larzelere

Google Pulls Back the Covers on Its First Machine Learning Chip

April 6, 2017

This week Google released a report detailing the design and performance characteristics of the Tensor Processing Unit (TPU), its custom ASIC for the inference Read more…

By Tiffany Trader

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Quantum Bits: D-Wave and VW; Google Quantum Lab; IBM Expands Access

March 21, 2017

For a technology that’s usually characterized as far off and in a distant galaxy, quantum computing has been steadily picking up steam. Just how close real-wo Read more…

By John Russell

HPC Compiler Company PathScale Seeks Life Raft

March 23, 2017

HPCwire has learned that HPC compiler company PathScale has fallen on difficult times and is asking the community for help or actively seeking a buyer for its a Read more…

By Tiffany Trader

Trump Budget Targets NIH, DOE, and EPA; No Mention of NSF

March 16, 2017

President Trump’s proposed U.S. fiscal 2018 budget issued today sharply cuts science spending while bolstering military spending as he promised during the cam Read more…

By John Russell

CPU-based Visualization Positions for Exascale Supercomputing

March 16, 2017

In this contributed perspective piece, Intel’s Jim Jeffers makes the case that CPU-based visualization is now widely adopted and as such is no longer a contrarian view, but is rather an exascale requirement. Read more…

By Jim Jeffers, Principal Engineer and Engineering Leader, Intel

Nvidia’s Mammoth Volta GPU Aims High for AI, HPC

May 10, 2017

At Nvidia's GPU Technology Conference (GTC17) in San Jose, Calif., this morning, CEO Jensen Huang announced the company's much-anticipated Volta architecture a Read more…

By Tiffany Trader

How ‘Knights Mill’ Gets Its Deep Learning Flops

June 22, 2017

Intel, the subject of much speculation regarding the delayed, rewritten or potentially canceled “Aurora” contract (the Argonne Lab part of the CORAL “ Read more…

By Tiffany Trader

Leading Solution Providers

Facebook Open Sources Caffe2; Nvidia, Intel Rush to Optimize

April 18, 2017

From its F8 developer conference in San Jose, Calif., today, Facebook announced Caffe2, a new open-source, cross-platform framework for deep learning. Caffe2 is the successor to Caffe, the deep learning framework developed by Berkeley AI Research and community contributors. Read more…

By Tiffany Trader

Reinders: “AVX-512 May Be a Hidden Gem” in Intel Xeon Scalable Processors

June 29, 2017

Imagine if we could use vector processing on something other than just floating point problems.  Today, GPUs and CPUs work tirelessly to accelerate algorithms Read more…

By James Reinders

Russian Researchers Claim First Quantum-Safe Blockchain

May 25, 2017

The Russian Quantum Center today announced it has overcome the threat of quantum cryptography by creating the first quantum-safe blockchain, securing cryptocurrencies like Bitcoin, along with classified government communications and other sensitive digital transfers. Read more…

By Doug Black

MIT Mathematician Spins Up 220,000-Core Google Compute Cluster

April 21, 2017

On Thursday, Google announced that MIT math professor and computational number theorist Andrew V. Sutherland had set a record for the largest Google Compute Engine (GCE) job. Sutherland ran the massive mathematics workload on 220,000 GCE cores using preemptible virtual machine instances. Read more…

By Tiffany Trader

Google Debuts TPU v2 and will Add to Google Cloud

May 25, 2017

Not long after stirring attention in the deep learning/AI community by revealing the details of its Tensor Processing Unit (TPU), Google last week announced the Read more…

By John Russell

Groq This: New AI Chips to Give GPUs a Run for Deep Learning Money

April 24, 2017

CPUs and GPUs, move over. Thanks to recent revelations surrounding Google’s new Tensor Processing Unit (TPU), the computing world appears to be on the cusp of Read more…

By Alex Woodie

Six Exascale PathForward Vendors Selected; DoE Providing $258M

June 15, 2017

The much-anticipated PathForward awards for hardware R&D in support of the Exascale Computing Project were announced today with six vendors selected – AMD Read more…

By John Russell

Top500 Results: Latest List Trends and What’s in Store

June 19, 2017

Greetings from Frankfurt and the 2017 International Supercomputing Conference where the latest Top500 list has just been revealed. Although there were no major Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Share This