SC19: IBM Changes Its HPC-AI Game Plan

By John Russell

November 25, 2019

It’s probably fair to say IBM is known for big bets. Summit supercomputer – a big win. Red Hat acquisition – looking like a big win. OpenPOWER and Power processors – jury’s out? At SC19, long-time IBMer Dave Turek sketched out a different kind of bet for Big Blue – a small ball strategy, if you’ll forgive the baseball analogy – in which the idea isn’t to sell big machines or infrastructure packages (those’re welcome, of course). Instead, IBM is rolling out an effort to “supercharge” existing installed HPC infrastructures using IBM AI expertise in systems with small footprints (i.e. price tags).

The idea is simple. Deploy small Power-based systems, perhaps as small as a single node, that take in application data and operations data from the client’s infrastructure, run it through IBM’s AI software – Turek emphasizes IBM’s Bayesian engine (IBM Bayesian Optimization) – to speed up applications and deliver value fast and at low cost and little disruption.

Dave Turek, IBM

“Just to drive home the point of what our ambition is; [it] is to produce solutions that are minimally or zero disruptive on installed base, okay, just so that we can shrink that sale cycle and make life as easy as possible for whatever the client is and what they’re doing,” Turek told HPCwire at an SC19 briefing. One can imagine IBM introducing systems optimized for one or another domain (manufacturing, finance, EDA, security, IT systems management, etc.) that use AI to dramatically speed up tasks running on the host infrastructure. None were announced.

Indeed, there were no new major IBM system announcements or major Power10 processor updates at SC19. Summit (148.6 PF Rmax) and Sierra (94.6 PF Rmax), both IBM machines, retained their spots atop the Top500. Instead, there was a short ‘white’ paper on IBM’s forthcoming Bayesian software which IBM says can speed-up and improve accuracy for all manner of simulations. IBM, for example, used it to reduce the number of EDA simulations by 79 percent on Power10 microprocessor development task.

“What I’ve been saying that I’ve not made explicit is that the kind of transition I’ve characterized here is also an articulation of the emergence of organic innovation coming from inside IBM. That maybe [in the past] some people looked at AI and said, well, AI is all about Nvidia’s GPU and Mellanox networks and Google’s TensorFlow and stuff like that. Those are like table stakes, if you will. But it’s actually the stuff that we’re working on here, which has all the value. I can’t deploy Nvidia GPUs and give you an eight times speed-up painlessly, right? That’s going to be a big bill. But if I can deploy a small Power cluster, got a few GPUs in it, and make your applications run 20 times faster.”

This idea of taking client data and using various AI capabilities to turn it into actionable insight isn’t new at IBM. That was at least part of the core IBM Watson strategy. At SC18, Turek, whose title just changed to vice president of high performance and cognitive computing, IBM Cognitive Systems, outlined a similar idea. The most recent formulation seems a more concrete plan with specific products to follow. The IBO software, for example, is currently in beta and will be generally available in the June 2020 timeframe according to Turek.

It’s not the case that IBM is turning its back on major system business, said Turek. In the last year or so it has, for example had significant recent success in academia with “MIT, Princeton University, University of Miami, University of Tennessee, RPI, TU Dresden, etc.,” noted Turek. Summit and Sierra, of course, were giants DoE wins and there was some surprise IBM didn’t win at least one of the forthcoming exascale machines. Energy giant Total’s Power9-based Pangea (17.9 Linpack petaflops) is among the largest commercial systems in the world.

The challenge is such large systems deals are scarce and OpenPower systems and Power microprocessor sales have not caught fire. Building a new ecosystem and dethroning x86 turned out to be a formidable task. With the new strategy, basically every existing substantial infrastructure is a potential target. For starters, wrangling through tedious capital budget cycles won’t be necessary.

“What we’re trying to do strategically is get away from this rip and replace phenomenon that’s characterized HPC since the beginning of time, get away from the lag in time of what it takes to get capital approvals and site preparation, all that stuff,” said Turek.

IBM shared few technology details about the new initiative beyond its current Bayesian centricity. AI, of course, encompasses a variety of machine learning, deep learning, and broad analytics technologies. Leveraging these, for example, to improve traditional HPC tasks such as modeling and simulation is an area of intense work right now across the HPC community.

Broadly, Bayesian approaches use real-world results and experience to inform models. (The approach dates back to its inventor Thomas Bayes (c. 1701-1761). IBM is pitching Bayesian optimization techniques as bringing intelligence to simulation. The excerpt below is from IBM’s brief paper being promoted at SC19 which briefly discusses examples from EDA, drug discovery, and computational chemistry:

“[To] close the efficiency gaps with traditional search methodology, optimization algorithms are bringing intelligence to the design and deployment of computational experiments. Bayes equation, and the statistics behind that equation, provides guidance on the most probable parameter set to advance the exploration of the response function. Bayesian optimization answers the question “based on the limited information I have, what is the best thing for me to do next?”

As always the market will decide based on technology, value, and ease of use. For the HPC community the approach sounds a little too “black boxish” but perhaps not. Skirting lengthy often contentious processes to free up capital budgets is always a plus if the cost is sufficiently low. There’s also the hope/expectation for follow-on sales of more nodes and other required infrastructure, storage for example.

Here’s Turek’s boiled-down pitch:

“So the Bayesian approach is much better because you have the sequential information passing back and forth between the simulation and Bayesian methods that give you information to orchestrate the way the simulations are run. So we take a solution. It’s a small Power cluster. It’s got the Bayesian software on it. You have an existing, I don’t know, a Haswell cluster, a few years old, running simulations and because your last dose of capital from your enterprise was five years ago, you can’t get another bunch of money. What do you do?

“What we would do is bring in our cluster, put it in the datacenter, and bring up a database and give access to that database from both sides. So [a] simulation runs, it puts output parameters into the database. I know something’s arrived, I go and inspect that, my machine learning algorithms analyze that, and it makes recommendations of the input parameters. So next simulation, rinse and repeat. And as you progress through this, the Bayesian machine learning solution gets smarter and smarter and smarter. And you get to get to your end game quicker and quicker and quicker. So empirical results: In the chemical formula formulation problem (that he cited). They reduced the amount of compute by two thirds. In discovery for new drugs for disease, they reduced the compute by 95 percent.

“I put it in a four-node cluster adjacent to my 2,000-node cluster, and I make my 2,000-node cluster behave as if it was an 8,000-node cluster? How long do I have to think about this?”

Stay tuned.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Graphcore Introduces Next-Gen Intelligence Processing Unit for AI Workloads

July 15, 2020

British hardware designer Graphcore, which emerged from stealth in 2016 to launch its first-generation Intelligence Processing Unit (IPU), has announced its next-generation IPU platform: the IPU-Machine M2000. With the n Read more…

By Oliver Peckham

heFFTe: Scaling FFT for Exascale

July 15, 2020

Exascale computing aspires to provide breakthrough solutions addressing today’s most critical challenges in scientific discovery, energy assurance, economic competitiveness, and national security. This has been the mai Read more…

By Jack Dongarra and Stanimire Tomov

There’s No Storage Like ATGC: Breakthrough Helps to Store ‘The Wizard of Oz’ in DNA

July 15, 2020

Even as storage density reaches new heights, many researchers have their eyes set on a paradigm shift in high-density information storage: storing data in the four nucleotides (A, T, G and C) that constitute DNA, a metho Read more…

By Oliver Peckham

Get a Grip: Intel Neuromorphic Chip Used to Give Robotics Arm a Sense of Touch

July 15, 2020

Moving neuromorphic technology from the laboratory into practice has proven slow-going. This week, National University of Singapore researchers moved the needle forward demonstrating an event-driven, visual-tactile perce Read more…

By John Russell

What’s New in HPC Research: Volcanoes, Mobile Games, Proteins & More

July 14, 2020

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

AWS Solution Channel

INEOS TEAM UK Accelerates Boat Design for America’s Cup Using HPC on AWS

The America’s Cup Dream

The 36th America’s Cup race will be decided in Auckland, New Zealand in 2021. Like all the teams, INEOS TEAM UK will compete in a boat whose design will have followed guidelines set by race organizers to ensure the crew’s sailing skills are fully tested. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

Joliot-Curie Supercomputer Used to Build First Full, High-Fidelity Aircraft Engine Simulation

July 14, 2020

When industrial designers plan the design of a new element of a vehicle’s propulsion or exterior, they typically use fluid dynamics to optimize airflow and increase the vehicle’s speed and efficiency. These fluid dyn Read more…

By Oliver Peckham

Graphcore Introduces Next-Gen Intelligence Processing Unit for AI Workloads

July 15, 2020

British hardware designer Graphcore, which emerged from stealth in 2016 to launch its first-generation Intelligence Processing Unit (IPU), has announced its nex Read more…

By Oliver Peckham

heFFTe: Scaling FFT for Exascale

July 15, 2020

Exascale computing aspires to provide breakthrough solutions addressing today’s most critical challenges in scientific discovery, energy assurance, economic c Read more…

By Jack Dongarra and Stanimire Tomov

Get a Grip: Intel Neuromorphic Chip Used to Give Robotics Arm a Sense of Touch

July 15, 2020

Moving neuromorphic technology from the laboratory into practice has proven slow-going. This week, National University of Singapore researchers moved the needle Read more…

By John Russell

Max Planck Society Begins Installation of Liquid-Cooled Supercomputer from Lenovo

July 9, 2020

Lenovo announced today that it is supplying a new high performance computer to the Max Planck Society, one of Germany's premier research organizations. Comprise Read more…

By Tiffany Trader

President’s Council Targets AI, Quantum, STEM; Recommends Spending Growth

July 9, 2020

Last week the President Council of Advisors on Science and Technology (PCAST) met (webinar) to review policy recommendations around three sub-committee reports: Read more…

By John Russell

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia’s Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 “Accelerator Optimized” VM A2 instance family on Google Compute Engine. The instances are powered by the HGX A100 16-GPU platform, which combines two HGX A100 8-GPU baseboards using... Read more…

By Tiffany Trader

Q&A: HLRS’s Bastian Koller Tackles HPC and Industry in Germany and Europe

July 6, 2020

In this exclusive interview for HPCwire – sadly not face to face – Steve Conway, senior advisor for Hyperion Research, talks with Dr.-Ing Bastian Koller about the state of HPC and its collaboration with Industry in Europe. Koller is a familiar figure in HPC. He is the managing director at High Performance Computing Center Stuttgart (HLRS) and also serves... Read more…

By Steve Conway, Hyperion

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time Read more…

By John Russell

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Leading Solution Providers


Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

John Martinis Reportedly Leaves Google Quantum Effort

April 21, 2020

John Martinis, who led Google’s quantum computing effort since establishing its quantum hardware group in 2014, has left Google after being moved into an advi Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This