What Power8 and OpenPOWER Might Mean for HPC

By Timothy Prickett Morgan

April 23, 2014

IBM is making a big play in hybrid computing, seeking to marry its POWER8 processors with various kinds of accelerators and high-speed networking and opening up its chip and system software through the OpenPOWER Foundation. At the Open Innovation Summit in San Francisco today, IBM and its foundation partners talked about how their collaboration would deliver machines better tuned for hyperscale Web applications and data analytics, but the same technologies will no doubt also be deployed in traditional supercomputing environments.

One could argue that what IBM is trying to accomplish with the OpenPOWER Foundation in an open way with many partners up and down the hardware and software stacks is based on ideas it put to the test many years ago in the “Roadrunner” petascale-class x86-Cell hybrid system at Los Alamos National Laboratory. This was the first large-scale accelerated system, and IBM seeks to make what was exotic with Roadrunner six years ago easier to do today and something more akin to normal in the years ahead.

IBM OpenPOWER Rosamilia Balog
At the Open Innovation Summit in San Francisco co-hosted by IBM and the OpenPOWER Foundation, Senior Vice President of IBM’s Systems and Technology Group Tom Rosamilia (left) and IBM General Manager of Power Systems Doug Balog (right) revealed the company’s POWER8 Systems. (Photo credit: Monica Davey/Feature Photo Service for IBM)

The POWER8 chip that was previewed today is about more than just increasing the core count by 50 percent and boosting the performance per socket on the order of 2X to 2.5X for various workloads compared to the POWER7 processors. IBM wants for all manner of accelerators to link very tightly with POWER8 processors and for scale-out clusters based on these chips to have the right kind of acceleration – be it a GPU, an FPGA, a DSP, or some other component – necessary for their particular jobs.

“The way I like to think about it is that with the POWER8 processor, we have created a superlane highway, and now we need cars driving on it,” explained Doug Balog, general manager of IBM’s Power Systems division, at the summit when announcing the new POWER8-based systems from IBM. “Very fast, very efficient vehicles. It is about that open interface that allows for that accelerator to attach to the POWER system.”

One of the interfaces that will be available to link accelerators to the POWER8 processors is IBM’s own Coherent Accelerator Processor Interface, or CAPI for short. This is an overlay on top of the PCI-Express 3.0 controllers on the POWER8 chip that will allow for high-speed linking between the CPU and accelerators and, more importantly, present a shared virtual memory space to applications across the memory attached to the CPU and any memory attached to the accelerator. Moving data back and forth between the CPU memory and the accelerator memory is a big hindrance to performance on accelerated machines, so making all memory addressable to all compute components is important.

Separately from IBM’s CAPI effort, but aligning nicely with it, NVIDIA has come up with its own NVLink interconnect, which will be used to hook its Tesla GPUs to POWER8 (and perhaps other) processors as well as to each other. Sumit Gupta, general manager of Tesla GPU Accelerated Computing Business unit at NVIDIA, said that NVLink would be incorporated into a future POWER processor design from IBM, and reminded everyone that the interconnect was part of the “Pascal” generation of GPUs from NVIDIA due in 2016 or so. NVIDIA is also going to license the technology behind NVLink to members of the OpenPOWER Foundation, Gupta said, and added that the two companies were in the meantime working on accelerating applications that combine POWER and Tesla compute. In the fourth quarter of this year, Gupta said, NVIDIA will deliver full support of its CUDA development environment for CPU-GPU hybrids on POWER processors, and in fact, IBM will also start shipping POWER8 systems that include Tesla GPU coprocessors.

“At the end of the day, the system is only as good as the software that takes advantage of it,” Gupta explained, “and that is why the future and the long-term focus is going to be around software.”

IBM is working with FPGA makers Xilinx and Altera to show the benefits of a hybrid setup running over the CAPI interface, so this is not just about GPU acceleration. Next week at the Impact2014 event, IBM and Xilinx will show a Memcached key value store application being accelerated by FPGAs and showing a factor of 35X better performance and an order of magnitude lower latency. A Monte Carlo simulation running on POWER machines accelerated by Altera FPGAs will show a factor of 200X speedup. Network adapter and switch maker Mellanox Technologies is also working with IBM to show how using Remote Direct Memory Access (RDMA) with a different key value store application boosted throughput and cut latencies by a factor of 10X.

There are a number of other benefits that come with POWER8 chips aside from high-speed links between processors and accelerators. The chips have a native little endian memory storage and accessing method, which is what x86 processors have and which stands in contrast to big endian ordering in memory. The important thing is this: with both x86 and POWER8 supporting little endian memory, applications that are coded from x86 systems to POWER8 systems are “a recompilation, a test, and a go,” as Balog put it. This is particularly important for C, C++, and Fortran and obviously has no bearing on interpreted languages like Java.

While the OpenPOWER Foundation members have not explicitly said they are seeking to accelerate traditional HPC applications, it is clear that these are core technologies that have been used – often first – in HPC systems. And there is no reason to believe that if IBM and its friends, including search engine giant Google, come up with more efficient ways of running plain vanilla POWER systems as well as hybrid machines that mix and match POWER chips and accelerators that these scale out systems will not end up in government and academic HPC centers. It will, as always, come down to having machines that suit a particular workload and at the right price. Suffice it to say that if IBM and its OpenPOWER Foundation partners can make a server that is low-cost enough to appeal to hyperscale datacenter operators, this will no doubt pique the interest of HPC centers.

In the meantime, IBM has divulged some details of the five new machines that it will sell based on the POWER8 processors. These are called the POWER Systems S-Class, and the “S” stands for scale out. Given the overwhelming adoption of Linux by the HPC community, the two Linux-only machines in the new line are probably the most appropriate, but one box that has slightly faster clock speeds might be interesting to HPC customers depending on what IBM charges for them.

The POWER S822L is a two-socket machine that fits into a 2U chassis, and it is probably the one that HPC shops will look at first. The system has room for two processor cards, which plug into the system board, and each one of them has a maximum of 512 GB of main memory. Customers can choose a POWER8 processor with ten of its twelve cores activated and running at 3.42 GHz or one with all twelve cores activated but running at only 3.02 GHz. This machine does not support cheap SATA disks, but does have room for a dozen 2.5-inch SAS drives or SSDs. It also has a storage cage with room for six 1.8-inch SSDs and has nine PCI-Express 3.0 slots. This machine will be available on June 10, and it supports Red Hat Enterprise Linux 6.5, SUSE Linux Enterprise Server 11 SP3, and Canonical Ubuntu Server 14.04 LTS. It can also run the POWERKVM hypervisor, a variant of the KVM hypervisor that IBM has created in conjunction with Red Hat and Canonical.

The POWER S812L comes with the same 2U chassis but only has one processor in it (the same options as the two-socket machine above) and only has six PCI-Express 3.0 peripheral slots. This machine will not ship until August, and will probably be less appealing to HPC shops because of its lower compute density compared to the POWER S822L.

The third machine that might see some HPC play is the POWER S822, which can run IBM’s AIX 6.1 or 7.1 operating systems or RHEL 6.5 or SLES 11 SP3. (It has not been certified to run Ubuntu Server, however.) This server can have one or two processor cards, and customers can choose between two different processors: a six-core POWER8 humming along at 3.89 GHz and a ten-core variant spinning at 3.42 GHz. Each socket in this machine supports up to 512 GB of memory, and it has six PCI slots with one processor card and nine with two processor cards.

IBM said that a base POWER Systems S-Class server would cost $7,973, but did not say what configuration or what specific system that cost was tied to. Big Blue is expected to put out pricing information on the new S-Class systems next week.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Is Data Science the Fourth Pillar of the Scientific Method?

April 18, 2019

Nvidia CEO Jensen Huang revived a decade-old debate last month when he said that modern data science (AI plus HPC) has become the fourth pillar of the scientific method. While some disagree with the notion that statistic Read more…

By Alex Woodie

At ASF 2019: The Virtuous Circle of Big Data, AI and HPC

April 18, 2019

We've entered a new phase in IT -- in the world, really -- where the combination of big data, artificial intelligence, and high performance computing is pushing the bounds of what's possible in business and science, in w Read more…

By Alex Woodie with Doug Black and Tiffany Trader

Google Open Sources TensorFlow Version of MorphNet DL Tool

April 18, 2019

Designing optimum deep neural networks remains a non-trivial exercise. “Given the large search space of possible architectures, designing a network from scratch for your specific application can be prohibitively expens Read more…

By John Russell

HPE Extreme Performance Solutions

HPE and Intel® Omni-Path Architecture: How to Power a Cloud

Learn how HPE and Intel® Omni-Path Architecture provide critical infrastructure for leading Nordic HPC provider’s HPCFLOW cloud service.

powercloud_blog.jpgFor decades, HPE has been at the forefront of high-performance computing, and we’ve powered some of the fastest and most robust supercomputers in the world. Read more…

IBM Accelerated Insights

Bridging HPC and Cloud Native Development with Kubernetes

The HPC community has historically developed its own specialized software stack including schedulers, filesystems, developer tools, container technologies tuned for performance and large-scale on-premises deployments. Read more…

Interview with 2019 Person to Watch Michela Taufer

April 18, 2019

Today, as part of our ongoing HPCwire People to Watch focus series, we are highlighting our interview with 2019 Person to Watch Michela Taufer. Michela -- the General Chair of SC19 -- is an ACM Distinguished Scientist. Read more…

By HPCwire Editorial Team

At ASF 2019: The Virtuous Circle of Big Data, AI and HPC

April 18, 2019

We've entered a new phase in IT -- in the world, really -- where the combination of big data, artificial intelligence, and high performance computing is pushing Read more…

By Alex Woodie with Doug Black and Tiffany Trader

Interview with 2019 Person to Watch Michela Taufer

April 18, 2019

Today, as part of our ongoing HPCwire People to Watch focus series, we are highlighting our interview with 2019 Person to Watch Michela Taufer. Michela -- the Read more…

By HPCwire Editorial Team

Intel Gold U-Series SKUs Reveal Single Socket Intentions

April 18, 2019

Intel plans to jump into the single socket market with a portion of its just announced Cascade Lake microprocessor line according to one media report. This isn Read more…

By John Russell

BSC Researchers Shrink Floating Point Formats to Accelerate Deep Neural Network Training

April 15, 2019

Sometimes calculating solutions as precisely as a computer can wastes more CPU resources than is necessary. A case in point is with deep learning. In early stag Read more…

By Ken Strandberg

Intel Extends FPGA Ecosystem with 10nm Agilex

April 11, 2019

The insatiable appetite for higher throughput and lower latency – particularly where edge analytics and AI, network functions, or for a range of datacenter ac Read more…

By Doug Black

Nvidia Doubles Down on Medical AI

April 9, 2019

Nvidia is collaborating with medical groups to push GPU-powered AI tools into clinical settings, including radiology and drug discovery. The GPU leader said Monday it will collaborate with the American College of Radiology (ACR) to provide clinicians with its Clara AI tool kit. The partnership would allow radiologists to leverage AI techniques for diagnostic imaging using their own clinical data. Read more…

By George Leopold

Digging into MLPerf Benchmark Suite to Inform AI Infrastructure Decisions

April 9, 2019

With machine learning and deep learning storming into the datacenter, the new challenge is optimizing infrastructure choices to support diverse ML and DL workfl Read more…

By John Russell

AI and Enterprise Datacenters Boost HPC Server Revenues Past Expectations – Hyperion

April 9, 2019

Building on the big year of 2017 and spurred in part by the convergence of AI and HPC, global revenue for high performance servers jumped 15.6 percent last year Read more…

By Doug Black

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

Arm Unveils Neoverse N1 Platform with up to 128-Cores

February 20, 2019

Following on its Neoverse roadmap announcement last October, Arm today revealed its next-gen Neoverse microarchitecture with compute and throughput-optimized si Read more…

By Tiffany Trader

France to Deploy AI-Focused Supercomputer: Jean Zay

January 22, 2019

HPE announced today that it won the contract to build a supercomputer that will drive France’s AI and HPC efforts. The computer will be part of GENCI, the Fre Read more…

By Tiffany Trader

Intel Launches Cascade Lake Xeons with Up to 56 Cores

April 2, 2019

At Intel's Data-Centric Innovation Day in San Francisco (April 2), the company unveiled its second-generation Xeon Scalable (Cascade Lake) family and debuted it Read more…

By Tiffany Trader

Oil and Gas Supercloud Clears Out Remaining Knights Landing Inventory: All 38,000 Wafers

March 13, 2019

The McCloud HPC service being built by Australia’s DownUnder GeoSolutions (DUG) outside Houston is set to become the largest oil and gas cloud in the world th Read more…

By Tiffany Trader

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Air Force Research Laboratory Unveils First Shared, Classified DoD HPC Capability

February 28, 2019

In a ceremony on Tuesday, the Air Force Research Laboratory unveiled four new computing clusters, providing the capability for what it is calling the first-ever Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This