HPC in 2008: Where the Growth Really Is

By Addison Snell, VP/GM, Tabor Research

January 4, 2008

In 2007 Tabor Research established the supply-side and demand-side research methodologies to determine the size and dynamics of the High Productivity Computing (HPC) market. From a technology perspective, we are investigating the products and services that complement the server or cluster portion of the HPC market, in order to establish the true market size beyond servers. From a usage perspective, we are looking beyond traditional HPC markets to new “threshold” application areas that have the potential for significant continued growth.

In mid-January Tabor Research will release preliminary 2007 revenue figures for the traditional HPC server market. This estimate will encompass all systems sold within traditional HPC markets, across industry, government and academia, including application areas such as manufacturing, oil and gas exploration, bio and life sciences, financial analytics, digital content creation or distribution, healthcare, utilities, academic and national research, and national defense.

We are currently validating our final figures with the HPC vendor community, but at this point we can state that the traditional HPC server market amounts to between $7.3 billion and $7.8 billion in 2007, which will represent single-digit growth rates from 2006. A critical basis to our methodology is that HPC servers represent about 15 percent to 17 percent of all server sales by revenue. Complete breakdowns of the traditional HPC server market – by product class (entry-level, midrange, high-end server, supercomputer), user sector (academia, government, industry), geography (U.S. and Canada, Latin America, EMEA, Asia Pacific), and vendor share – will be made available to subscribers to the Tabor Research InterSect360 market advisory service and to the user members on the HPC User Views Advisory Council who contribute to our demand-side research modules.

Prediction #1: Look for Technology Innovation outside the Server

The HPC market goes well beyond servers. In our first demand-side report published in 2007, users revealed how they allocate their HPC budgets among and within major spending categories: hardware, software, services, facilities, staffing, and outsourcing. A major finding of this study was that users spend only about one-third of their total HPC budgets on servers. They spent roughly an equal amount on other HPC products and services, with the remainder going to internal spending categories, such as staffing, power consumption, and cooling.

Counting servers as half of the total external spending in the HPC market means we can at least double the server revenue number to come up with the total size of the traditional HPC market, including items such as storage, interconnects, and services, to approximately $15 billion. In truth, this figure is slightly higher because of “not in budget” effects for some categories of spending, especially storage, in which additional monies come from IT budgets that support HPC but are not HPC-specific.

Among the non-server product spending categories, storage is perhaps the most critical. Not only does it command a significant percentage of the HPC budget, but it also is a technology area that can have enormous influence over the true productivity of a system. Furthermore there are technology shifts in play in file systems and storage interconnects that complicate users’ buying decisions. A comprehensive research study conducted by Tabor Research in 2007 concluded that in addition to simple metrics such as increased capacity and higher bandwidth, users are interested in storage solutions that drive improvements in application performance.

Interconnects are another major component of the overall solution, and they are another area that is undergoing a technology change. The growth in InfiniBand adoption has been a hot topic in 2006 and 2007, but at SC07 we noticed many companies showing their new 10 Gigabit Ethernet solutions. What interested us most about this was that rather than the newest generation of Ethernet simply appearing as a matter-of-fact “it’s here, and we have it” announcement, many vendors were touting differentiation in their 10GbE solutions. If users view Ethernet as something more than a check-box item, the dynamics of the interconnect market will be important to watch in 2008.

Prediction #2: Multi-Core Drives Further Node Changes

As multi-core becomes the standard option for new HPC purchases, users will continue to grapple with the introduction of parallelism at the socket level. In addition, memory and cache contention will become major bottlenecks for certain applications. The rapid shift to multi-core will drive innovation in several related areas within the node.

With increasing numbers of processing cores per socket, users will need to rebalance node configurations to optimize data movement between processors, memory, and storage. The challenge here is not to overload a node with processing cores that will be idle for most of the time waiting for data from memory or disk. For some users it may prove more cost-effective to reduce processor chip count and spend their money on larger memory and additional I/O ports.

As another option for increasing node-level performance, 2008 will see widespread experimentation with various accelerator technologies. We expect to see an earnest effort made to employ the full panoply of accelerator options (e.g. FPGAs, GPGPUs, game chips, purpose-built accelerators, etc.) across virtually all applications segments. However, these efforts will generally be in the “proof of concept” phase, with relatively small numbers of accelerators deployed. We expect this experimentation to continue into 2009.

Prediction #3: Software Strives to Catch Up

The demand for software tools that can reduce the complexity of programming and managing multi-node, multi-processor, multi-core systems will reach an all-time high during the year. Users will seek software innovations across the entire range of HPC activities.

  • Responding to multi-core — Users will need to implement job scheduling and optimizing software to maximize the efficiency of clusters based on multicore processors. In addition, users will look for software solutions to help them deal with power and cooling challenges within the computer room.
  • Programming complexity — Like death and taxes, programming complexity will always be with us (and just as welcome). 2008 will test the limitations of MPI and current programming methods, while opportunities open up for extensions of existing programming tools and development of new approaches.
  • Support for accelerator implementation — Programmability is the most limiting factor to accelerator adoption. The ultimate winners in the accelerator race will be companies that can provide both efficient processor-to-accelerator operations and effective programming tools for accelerator use.

Prediction #4: Productivity Measurements Get More Sophisticated

Productivity encompasses more than price/performance. This becomes more evident with the adoption of multi-core systems with high peak performance and potential programming challenges. Users have embraced the concept of evaluating the usefulness of HPC systems based on productivity in theory, but putting it in practice for actual acquisitions has been difficult, because the “productivity” concept lacks simple metrics and tools.

In 2008 Tabor Research will introduce tools for users to better evaluate end-to-end workflow optimization – a major step in supporting its emphasis on productivity beyond performance. In addition, several users have already designed their own internal productivity metrics, and many HPC system and solution vendors are showing interest in productivity metrics as well. For example, Microsoft highlighted productivity as the centerpiece of its HPC++ campaign unveiled at SC07.

Prediction #5: Threshold Applications Are the Major Growth Area

Advancements in technology, improvements in price/performance, and true productivity gains have combined to make HPC an attractive investment in non-traditional application areas. Tabor Research refers to these as “threshold applications.” A threshold HPC application is one that:

  • Does not fit into established, traditional definitions of HPC applications, or is a distinct subset within a category that has not previously benefited from HPC.
  • Is enabled by recent advancements in HPC technology, price/performance, or productivity.
  • Reflects traditional HPC applications in its overall workflow or type of configuration required.
  • Has the potential for significant growth in HPC, i.e., computational methods could become the new paradigm.

For example, in the finance industry, HPC systems have traditionally been deployed for financial analytics or portfolio risk analysis. Recently some users have begun to use HPC system for real-time trading solutions. This is a new application subset with an HPC workflow that shows potential for industry-wide adoption.

Another important category within threshold applications is “ultra-scale business computing.” This is our catch-all designation for applications that are not HPC in of themselves, but which require supercomputing levels of scale for certain users, thus resulting in the use of proprietary or HPC-specific solutions or technologies. For example, web-based transactions or searches are not HPC applications per se, but eBay and Google use supercomputing technologies to run them at extreme scale. Tabor Research tracks this usage as part of the threshold supercomputing market.

These threshold applications represent a significant opportunity in the market, and they have the potential for significant growth. We are currently modeling market sizes for these applications (a comprehensive research study is pending in 2008), and at present estimate an additional 35 percent of revenue to the HPC market.

Conclusions

When we consider the traditional HPC server market, additional spending on technologies outside the server, and the impact of non-traditional, threshold applications, the total HPC market is on the order of $20 billion to $28 billion. HPC overall is growing, but the fastest growth rates are in the threshold application areas.

Tabor Research predicts that the focus for high productivity will shift away from the server in 2008 and toward the overall computing environment, including storage, interconnects, software and accelerators. This focus will come from the drive to achieve true productivity, and users will strive to quantify and optimize the productivity of their HPC investments.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Penguin Computing Brings Cascade Lake-AP to OCP Form Factor

July 7, 2020

Penguin Computing, a subsidiary of SMART Global Holdings, Inc., is announcing a new Tundra server, Tundra AP, that is the first to implement the Intel Xeon Scalable 9200 series processors (codenamed Cascade Lake-AP) in t Read more…

By Tiffany Trader

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia's Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 "Accelerator Optimized" VM A2 instance family on Google Compute Engine. The instances are powered by t Read more…

By Tiffany Trader

Q&A: HLRS’s Bastian Koller Tackles HPC and Industry in Germany and Europe

July 6, 2020

HPCwire: Let's start with HLRS and work our way up to the European scale. HLRS has stood out in the HPC world for its support of both scientific and industrial research. Can you discuss key developments in recent years? Read more…

By Steve Conway, Hyperion

The Barcelona Supercomputing Center Offers a Virtual Tour of Its MareNostrum Supercomputer

July 6, 2020

With the COVID-19 pandemic continuing to threaten the world and disrupt normal operations, facility tours remain a little difficult to operate, with many supercomputing centers having shuttered facility tours for visitor Read more…

By Oliver Peckham

What’s New in Computing vs. COVID-19: Fugaku, Congress, De Novo Design & More

July 2, 2020

Supercomputing, big data and artificial intelligence are crucial tools in the fight against the coronavirus pandemic. Around the world, researchers, corporations and governments are urgently devoting their computing reso Read more…

By Oliver Peckham

AWS Solution Channel

Maxar Builds HPC on AWS to Deliver Forecasts 58% Faster Than Weather Supercomputer

When weather threatens drilling rigs, refineries, and other energy facilities, oil and gas companies want to move fast to protect personnel and equipment. And for firms that trade commodity shares in oil, precious metals, crops, and livestock, the weather can significantly impact their buy-sell decisions. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time last year, IBM announced open sourcing its Power instructio Read more…

By John Russell

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia's Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 "Accelerator Optimized" VM A2 instance fam Read more…

By Tiffany Trader

Q&A: HLRS’s Bastian Koller Tackles HPC and Industry in Germany and Europe

July 6, 2020

HPCwire: Let's start with HLRS and work our way up to the European scale. HLRS has stood out in the HPC world for its support of both scientific and industrial Read more…

By Steve Conway, Hyperion

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time Read more…

By John Russell

Hyperion Forecast – Headwinds in 2020 Won’t Stifle Cloud HPC Adoption or Arm’s Rise

June 30, 2020

The semiannual taking of HPC’s pulse by Hyperion Research – late fall at SC and early summer at ISC – is a much-watched indicator of things come. This yea Read more…

By John Russell

Racism and HPC: a Special Podcast

June 29, 2020

Promoting greater diversity in HPC is a much-discussed goal and ostensibly a long-sought goal in HPC. Yet it seems clear HPC is far from achieving this goal. Re Read more…

Top500 Trends: Movement on Top, but Record Low Turnover

June 25, 2020

The 55th installment of the Top500 list saw strong activity in the leadership segment with four new systems in the top ten and a crowning achievement from the f Read more…

By Tiffany Trader

ISC 2020 Keynote: Hope for the Future, Praise for Fugaku and HPC’s Pandemic Response

June 24, 2020

In stark contrast to past years Thomas Sterling’s ISC20 keynote today struck a more somber note with the COVID-19 pandemic as the central character in Sterling’s annual review of worldwide trends in HPC. Better known for his engaging manner and occasional willingness to poke prickly egos, Sterling instead strode through the numbing statistics associated... Read more…

By John Russell

ISC 2020’s Student Cluster Competition Winners Announced

June 24, 2020

Normally, the Student Cluster Competition involves teams of students building real computing clusters on the show floors of major supercomputer conferences and Read more…

By Oliver Peckham

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers

Contributors

Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This