Conference Highlights Dividing Lines Across GPGPUs

By Michael Feldman

November 19, 2010

If there was a dominating theme at the Supercomputing Conference this year, it had to be GPU computing. From the influx of GPU-accelerated systems on the TOP500, including the number one system in the world to the inclusion of GPGPUs into nearly every discussion of exascale machines to the visibility of GPUs across the exhibition hall, the technology seemed to be ubiquitous at SC10.

Arguably, the biggest vendor announcement at the show was the launch of SGI’s Prism XL machine, and although that system is designed as a general-purpose platform for various kinds of HPC accelerators, it’s almost a given that the vast majority will be shipped with GPUs.

Today, every major and minor HPC system vendor now offers GPU-equipped servers, with plans by many to expand their portfolio over the next year. And that can only mean the customer demand for such technology is now palpable. In fact, if you aspire to be an HPC OEM or software provider and don’t have a GPU strategy, the next few years are going to be mighty lonely.

But not everyone at SC10 was hopping on the GPU bandwagon. (And I’m not just talking about the Convey folks.) There is a definite divide in the HPC application community about the value of graphics processors for science codes. I spoke with a number of developers who had played with GPUs and found they couldn’t realize that magical 10X performance bump they felt they needed to commit their applications to a new platform. Although there are plenty of technical computing applications that have been ported to CUDA, many — the majority, in fact — have not.

CAPS enterprise, makers of GPU-friendly compiler tools, offers a support service for porting codes to GPUs and found that 10X speedups should be considered quite good for an HPC application. According the them, getting to 100X or beyond would be attainable only by those algorithms that are not memory-bound, that is, those dominated by computation rather than memory access. Most of the customer applications they’ve worked with have been able to achieve between 2X and 10X performance increases when ported to GPUs, and sometimes that’s not enough for to justify a platform change. In some cases, reworking of the CPU component, alone, achieved a significant speedup. Only about half of the CAPS customers that were considering ports have made the jump to GPGPUs.

In talking with people here at SC10 and at NVIDIA’s GPU Technology Conference in September, my impression is that the bigger, older codes are more resistance to being ported to GPUs than smaller and newer ones. And it makes perfect sense. In many cases, those older codes are no longer attached to their original developers, which makes transforming the algorithms into a GPU-friendly design (or any design) that much harder. Also, legacy codes tend to have accumulated kludges and tweaks that make such redesigns extremely painful. This feeds into the human aspect of software engineering, where the if-it-aint-broke-don’t-fix-it crowd often dominates the software maintenance mentality.

This might help to explain the slow response of the US and Europe to adopt GPU-equipped supercomputers, at least at the level of the large national labs and universities. After all, this is where many of those legacy HPC codes are developed and maintained. That said, I suspect there are actually more GPU-accelerated clusters in the US and Europe than anywhere else; it’s the petascale systems that have not been forthcoming. At this point, the West is at least a year behind China and Japan in the GPGPU supercomputer arms race.

GPU computing skeptics can also point to evidence that there are better architectures for supercomputing already out there, or soon to be launched. For example, despite the enviable performance per watt of the graphics processor, the number one system on the just-announced Green500 list is a Blue Gene/Q prototype system. Of course, that’s cheating a bit, given that production Blue Gene/Q systems don’t yet exist. But the prototype Q did manage to beat the state-of-the-art TSUBAME 2.0 GPU supercomputer rather handily — 1684 megaflops/watt to 984 megaflops/watt. I suspect the “green” matchup will be much closer in 2011, when NVIDIA’s next-generation “Kepler” hardware and Blue Gene/Q are both in the field.

Also, the top system on the new Graph 500 list was the IBM Blue Gene/P system at Argonne National Lab. The Graph 500 attempts to measure the suitability of platforms for data analytics-type workloads, which is not the strong suit of the graphics processor, at least in its current incarnation. Graph problems require an architecture that can do a lot of random data accesses across memory at a very high rate. Few conventional computing architectures — CPU, GPU or otherwise — are any good at this.

Committed GPU computing dissenters are likely pinning their hopes on Intel’s Many Integrated Core (MIC) architecture, which is designed to address the same problem space as GPGPUs, but does so with a conventional x86 architecture. For the risk-averse, there is certainly an allure to recompiling your legacy source code with a future Intel compiler that will automagically spit out MIC code. But waiting until 2012 to see if that chip and compiler deliver as advertised could be the riskiest bet of all. Of course, we’ll have to wait until SC12 to see how this story turns out.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Hyperion: HPC Server Market Ekes 1 Percent Gain in 2020, Storage Poised for ‘Tipping Point’

May 12, 2021

The HPC User Forum meeting taking place virtually this week (May 11-13) kicked off with Hyperion Research’s market update, covering the 2020 period. Although the HPC server market had been facing a 6.7 percent COVID-re Read more…

Finland’s CSC Chronicles the COVID Research Performed on Its ‘Puhti’ Supercomputer

May 11, 2021

CSC, Finland’s IT Center for Science, is home to a variety of computing resources, including the 1.7 petaflops Puhti supercomputer. The 682-node, Intel Cascade Lake-powered system, which places about halfway down the T Read more…

IBM Debuts Qiskit Runtime for Quantum Computing; Reports Dramatic Speed-up

May 11, 2021

In conjunction with its virtual Think event, IBM today introduced an enhanced Qiskit Runtime Software for quantum computing, which it says demonstrated 120x speedup in simulating molecules. Qiskit is IBM’s quantum soft Read more…

AMD Chipmaker TSMC to Use AMD Chips for Chipmaking

May 8, 2021

TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs – with 64 cores operating at a base clock of 2.0GHz – implemented in HPE's single-socket ProLian Read more…

Supercomputer Research Tracks the Loss of the World’s Glaciers

May 7, 2021

British Columbia – which is over twice the size of California – contains around 17,000 glaciers that cover three percent of its landmass. These glaciers are crucial for the Canadian province, which relies on its many Read more…

AWS Solution Channel

FLYING WHALES runs CFD workloads 15 times faster on AWS

FLYING WHALES is a French startup that is developing a 60-ton payload cargo airship for the heavy lift and outsize cargo market. The project was born out of France’s ambition to provide efficient, environmentally friendly transportation for collecting wood in remote areas. Read more…

Meet Dell’s Pete Manca, an HPCwire Person to Watch in 2021

May 7, 2021

Pete Manca heads up Dell's newly formed HPC and AI leadership group. As senior vice president of the integrated solutions engineering team, he is focused on custom design, technology alliances, high-performance computing Read more…

Hyperion: HPC Server Market Ekes 1 Percent Gain in 2020, Storage Poised for ‘Tipping Point’

May 12, 2021

The HPC User Forum meeting taking place virtually this week (May 11-13) kicked off with Hyperion Research’s market update, covering the 2020 period. Although Read more…

IBM Debuts Qiskit Runtime for Quantum Computing; Reports Dramatic Speed-up

May 11, 2021

In conjunction with its virtual Think event, IBM today introduced an enhanced Qiskit Runtime Software for quantum computing, which it says demonstrated 120x spe Read more…

AMD Chipmaker TSMC to Use AMD Chips for Chipmaking

May 8, 2021

TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs – with 64 cores operating at a base cl Read more…

Fast Pass Through (Some of) the Quantum Landscape with ORNL’s Raphael Pooser

May 7, 2021

In a rather remarkable way, and despite the frequent hype, the behind-the-scenes work of developing quantum computing has dramatically accelerated in the past f Read more…

IBM Research Debuts 2nm Test Chip with 50 Billion Transistors

May 6, 2021

IBM Research today announced the successful prototyping of the world's first 2 nanometer chip, fabricated with silicon nanosheet technology on a standard 300mm Read more…

LRZ Announces New Phase of SuperMUC-NG Supercomputer with Intel’s ‘Ponte Vecchio’ GPU

May 5, 2021

At the Leibniz Supercomputing Centre (LRZ) in München, Germany – one of the constituent centers of the Gauss Centre for Supercomputing (GCS) – the SuperMUC Read more…

Crystal Ball Gazing at Nvidia: R&D Chief Bill Dally Talks Targets and Approach

May 4, 2021

There’s no quibbling with Nvidia’s success. Entrenched atop the GPU market, Nvidia has ridden its own inventiveness and growing demand for accelerated computing to meet the needs of HPC and AI. Recently it embarked on an ambitious expansion by acquiring Mellanox (interconnect)... Read more…

Intel Invests $3.5 Billion in New Mexico Fab to Focus on Foveros Packaging Technology

May 3, 2021

Intel announced it is investing $3.5 billion in its Rio Rancho, New Mexico, facility to support its advanced 3D manufacturing and packaging technology, Foveros. Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

AMD Chipmaker TSMC to Use AMD Chips for Chipmaking

May 8, 2021

TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs – with 64 cores operating at a base cl Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

GTC21: Nvidia Launches cuQuantum; Dips a Toe in Quantum Computing

April 13, 2021

Yesterday Nvidia officially dipped a toe into quantum computing with the launch of cuQuantum SDK, a development platform for simulating quantum circuits on GPU-accelerated systems. As Nvidia CEO Jensen Huang emphasized in his keynote, Nvidia doesn’t plan to build... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2021) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire