Hyperion: Deep Learning, AI Helping Drive Healthy HPC Industry Growth

By Doug Black

June 20, 2017

To be at the ISC conference in Frankfurt this week is to experience deep immersion in deep learning. Users want to learn about it, vendors want to talk about it, analysts and journalists want to report on it. Deep learning underlays Hyperion Research’s optimistic HPC market forecast, with the former IDC HPC analyst team noting that deep learning (and high performance data analytics) is driving HPC into organizations that aren’t even aware they’re “doing HPC.”

Adoption of deep learning is one of several “Dark Energy” forces expanding the HPC universe in ways that are difficult to observe directly, said Hyperion’s Bob Sorensen. Other compute- and data-intensive forces pushing industry growth are security anomaly detection, financial services applications and the offloading of HPC workloads to the public cloud.

While non-traditional HPC procurements are difficult for analyst groups like Hyperion to track, what can be observed is that traditional enterprise servers don’t have the computational capabilities for advanced AI workloads, such as training neural networks for deep learning tasks, Sorensen said. Right now, deep learning is mostly happening at the big internet and social media FANG (Facebook, Amazon, Netflix and Google [now Alphabet], and Microsoft) companies, along with autonomous vehicle companies. Its broader adoption in the enterprise over the next several years is a major reason Hyperion is bullish on the HPC industry between now and 2021.

The analyst group announced today the overall HPC server market worldwide in 2016 generated record revenues of $11.2 billion, growth of 4.5 percent over 2015. Hyperion divides the HPC server market into four price-based sectors (see slide), with the supercomputer category (cost: more than $500,000) taking the lion’s share with $4.1 billion.

Growth of this kind is expected to continue, with Hyperion projecting the total HPC server industry to reach $14.8 billion by 2021, led by growth in the supercomputer category followed, in order, by divisional, departmental and workgroup systems.

Taking the HPC ecosystem as a whole – including servers, storage, middleware applications and services – the industry had revenues of more than $22 billion in 2016. With an expected CAGR of 6.2 percent, Hyperion expects the total worth of the sector to reach $30 billion by 2021. Storage is expected to be the fastest growing sector, with an annual growth rate of 7.8 percent.

Earl Joseph of Hyperion

Hyperion reported that HPE has established itself as the no. 1 HPC server vendor, with sales of $3.8 billion (of the $11.2 billion total) last year, followed by Dell EMC at $2.0 billion, Lenovo at $909 million and IBM at $492 million. As for HPC market sectors, the government/national labs led with purchases totaling $2.1 billion, followed by university/academia at $1.9 billion. Among industrial sectors, computer-aided engineering led with $1.2 billion, then bio-sciences at $1B, followed by geosciences at $844 million.

At the pinnacle of the supercomputer sector is the drive to exascale computing. Hyperion examined the four leading countries/regions (the U.S., China, the EU and Japan) and said China may win the race, predicting a Chinese system delivering exascale at peak by 2020 (possibly by 2019) and sustained exascale performance by 2023. It expects the U.S. to deliver peak exascale by 2020 and sustained by 2023. The EU and Japan are projected to reach sustained exascale performance by 2023 or 2024. Joseph noted that China’s exascale system may be powered by Chinese processors, rather than American.

While innovations developed for exascale systems will work their way into the broader government/academic/industrial sectors, near term HPC industry growth will be driven by demand in industrial and commercial sectors adopting more power HPDA (high performance data analytics) and deep learning capabilities.

Hyperion’s Steve Conway said 200 companies in recent years “have moved up to HPC because of competitive forces and requirements – complexity and time criticality – have pushed them up into the HPC competency space. These are companies that for the most part have hit a wall with enterprise services technology. They don’t have HPC data centers and they’re not going to build them, they’re inserting HPC at the right point into the live workflow in the enterprise.”

Sorensen said a typical scenario is a traditional company using conventional servers, “and you have a business intelligence capability that’s just inundated with data – more types of data, more data coming in faster, and people wanting results in real time or nearly so. So you’re being dragged kicking and screaming into the HPC environment. You’re coming at it (HPC) from an entirely different orthogonal direction. You’re doing HPC, you just don’t know it yet.”

Hyperion also expects HPC capabilities on public cloud computing platforms to generate increasing demand, though for now it’s showing more potential than actual results. Conway said Hyperion found that 64 percent of HPC sites run “some” jobs in public clouds, up from 13 percent in 2011. But those sites only run 7 to 8 percent of their total workloads in the cloud, roughly the same as six years ago.

“It’s a phenomenon of the public cloud in HPC is getting very wide but not very deep yet,” he said. But it’s a market with strong potential, Conway said. Hyperion asked HPC data center managers how difficult it is to decide which jobs to keep on premises and which to send off-prem. In a high percentage of cases, Conway said, the response was that it’s not difficult at all.

“If the clouds are architected to be more friendly to HPC jobs, people are going to send them more jobs,” Conway said. “There’s not a big educational effort (by the public cloud providers) that’s needed here, it has to do with the appropriateness of the jobs.”

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Research: A Survey of Numerical Methods Utilizing Mixed Precision Arithmetic

August 5, 2020

Within the past years, hardware vendors have started designing low precision special function units in response to the demand of the machine learning community and their demand for high compute power in low precision for Read more…

By Hartwig Anzt and Jack Dongarra

Implement Photonic Tensor Cores for Machine Learning?

August 5, 2020

Researchers from George Washington University have reported an approach for building photonic tensor cores that leverages phase change photonic memory to implement a neural network (NN). Their novel architecture, reporte Read more…

By John Russell

HPE Keeps Cray Brand Promise, Reveals HPE Cray Supercomputing Line

August 4, 2020

The HPC community, ever-affectionate toward Cray and its eponymous founder, can breathe a (virtual) sigh of relief. The Cray brand will live on, encompassing the pinnacle of HPE's HPC portfolio. After announcing its i Read more…

By Tiffany Trader

Machines, Connections, Data, and Especially People: OAC Acting Director Amy Friedlander Charts Office’s Blueprint for Innovation

August 3, 2020

The path to innovation in cyberinfrastructure (CI) will require continued focus on building HPC systems and secure connections between them, in addition to the increasingly important goals of data best practices and work Read more…

By Ken Chiacchia, Pittsburgh Supercomputing Center/XSEDE

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated, analysts said the acquisition would cement Nvidia’s stat Read more…

By George Leopold

AWS Solution Channel

AWS announces the release of AWS ParallelCluster 2.8.0

AWS ParallelCluster is a fully supported and maintained open source cluster management tool that makes it easy for scientists, researchers, and IT administrators to deploy and manage High Performance Computing (HPC) clusters in the AWS cloud. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

Summer Reading: Here’s a Quantum Advantage You Can Bet On!

August 3, 2020

While quantum computing researchers today vigorously chase a demonstration of a quantum advantage – an application which when run on a quantum computer provides sufficient advantage to warrant switching from a classica Read more…

By John Russell

HPE Keeps Cray Brand Promise, Reveals HPE Cray Supercomputing Line

August 4, 2020

The HPC community, ever-affectionate toward Cray and its eponymous founder, can breathe a (virtual) sigh of relief. The Cray brand will live on, encompassing th Read more…

By Tiffany Trader

Machines, Connections, Data, and Especially People: OAC Acting Director Amy Friedlander Charts Office’s Blueprint for Innovation

August 3, 2020

The path to innovation in cyberinfrastructure (CI) will require continued focus on building HPC systems and secure connections between them, in addition to the Read more…

By Ken Chiacchia, Pittsburgh Supercomputing Center/XSEDE

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated Read more…

By George Leopold

Intel’s 7nm Slip Raises Questions About Ponte Vecchio GPU, Aurora Supercomputer

July 30, 2020

During its second-quarter earnings call, Intel announced a one-year delay of its 7nm process technology, which it says it will create an approximate six-month shift for its CPU product timing relative to prior expectations. The primary issue is a defect mode in the 7nm process that resulted in yield degradation... Read more…

By Tiffany Trader

PEARC20 Plenary Introduces Five Upcoming NSF-Funded HPC Systems

July 30, 2020

Five new HPC systems—three National Science Foundation-funded “Capacity” systems and two “Innovative Prototype/Testbed” systems—will be coming onlin Read more…

By Ken Chiacchia, Pittsburgh Supercomputing Center/XSEDE

Nvidia Dominates Latest MLPerf Training Benchmark Results

July 29, 2020

MLPerf.org released its third round of training benchmark (v0.7) results today and Nvidia again dominated, claiming 16 new records. Meanwhile, Google provided e Read more…

By John Russell

$39 Billion Worldwide HPC Market Faces 3.7% COVID-related Drop in 2020

July 29, 2020

Global HPC market revenue reached $39 billion in 2019, growing a healthy 8.2 percent over 2018, according to the latest analysis from Intersect360 Research. A 3 Read more…

By Tiffany Trader

Agenting Change: PEARC20 Keynote Encourages Cultural Change to Make Tech Better, More Diverse

July 29, 2020

The tech world will need to become more diverse if it is to thrive and survive, said Cherri Pancake, director of the Northwest Alliance for Computational Resear Read more…

By Ken Chiacchia, Pittsburgh Supercomputing Center/XSEDE

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

Supercomputer-Powered Research Uncovers Signs of ‘Bradykinin Storm’ That May Explain COVID-19 Symptoms

July 28, 2020

Doctors and medical researchers have struggled to pinpoint – let alone explain – the deluge of symptoms induced by COVID-19 infections in patients, and what Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

Intel’s 7nm Slip Raises Questions About Ponte Vecchio GPU, Aurora Supercomputer

July 30, 2020

During its second-quarter earnings call, Intel announced a one-year delay of its 7nm process technology, which it says it will create an approximate six-month shift for its CPU product timing relative to prior expectations. The primary issue is a defect mode in the 7nm process that resulted in yield degradation... Read more…

By Tiffany Trader

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

Nvidia Said to Be Close on Arm Deal

August 3, 2020

GPU leader Nvidia Corp. is in talks to buy U.K. chip designer Arm from parent company Softbank, according to several reports over the weekend. If consummated Read more…

By George Leopold

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

Leading Solution Providers

Contributors

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Joliot-Curie Supercomputer Used to Build First Full, High-Fidelity Aircraft Engine Simulation

July 14, 2020

When industrial designers plan the design of a new element of a vehicle’s propulsion or exterior, they typically use fluid dynamics to optimize airflow and in Read more…

By Oliver Peckham

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

John Martinis Reportedly Leaves Google Quantum Effort

April 21, 2020

John Martinis, who led Google’s quantum computing effort since establishing its quantum hardware group in 2014, has left Google after being moved into an advi Read more…

By John Russell

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia’s Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 “Accelerator Optimized” VM A2 instance family on Google Compute Engine. The instances are powered by the HGX A100 16-GPU platform, which combines two HGX A100 8-GPU baseboards using... Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This