HP Launches HPC & Big Data Global Business Unit

By John Russell

June 4, 2015

When HP finally divides into two pieces – HP Inc. (PCs and printers) and Hewlett Packard Enterprise (servers and services) – how will the HPC portfolio fare? Views vary of course. The split is meant to let the ‘new’ companies shed distraction and sharpen focus. HPC will live within HP Enterprise, but perhaps surprisingly not by itself. Instead HPC is being combined with Big Data into a single global business unit, HPC & Big Data, created in March and led by longtime SGI executive and recent HP import, William Mannel.

“It’s not by mistake or coincidence we put HPC and Big Data together,” said Mannel, now VP and General Manager of the HPC & Big Data GBU. “We believe storing Big Data is one thing and we have technologies to do that. Getting productive use out of [the data] is another thing and many customers are using similar types of technologies to get value out of their Big Data.”

Hired last November and a key architect of the new GBU, Mannel discussed with HPCwire the HP strategy for expanding its HPC focus, why the timing is right to push into the enterprise, what some of the obstacles (and solutions) are, and the steady rise of new technologies – x86 still dominates (including at HP) but competitors (GPU, FPGA, OpenPower, ARM) are winning sockets in a trend likely to continue.

Don’t get the wrong idea. HP is hardly abandoning the HPC stratosphere. It still holds the overall lead in Top 500 systems (Nov. 2014) with 179 (36 percent) compared to IBM with 153 systems (30 percent) according to Top 500 organizers. It should be noted those numbers are down slightly for both companies. HP had 182 systems (36.4 percent) six months earlier, and IBM had 176 systems (35.2 percent).

“By any of the metrics you want to use we are already HPC leaders. We know we’re under represented in the top 100 and are expecting to drive forward into that portion of the market as well. However we think there’s additional opportunity to grow in the enterprise and that’s why we created a global business unit specifically to focus on HPC and Dig Data.”

This notion of aligning HPC and Big Data has steadily gained traction. Many see a growing trend (or at least an obvious desire) by enterprises of all sizes to capitalize on Big Data (internally generated or externally available). Add to this the effort by vendors to evangelize and sell HPC to small and medium business seeking to differentiate themselves using traditionally HPC-dependent tools (modeling, simulation, etc.) and suddenly the enterprise HPC market looks enticing and big.

For the most part the analyst community seems to agree.

Market watcher IDC, which has adopted the HPDA acronym (high performance data analysis), has reported 67 percent of HPC sites use HPDA today and forecast the 2016 HPDA server and storage market at $1.2B and $800M respectively and growing faster than most segments.

Addison Snell, CEO, Intersect360, said, “HP’s strategy to combine HPC and Big Data internally is consistent with the industry dynamics we see, where there are now large categories of enterprise applications that are reliant on performance and scalability. One of HP’s strengths is its position in high-performance storage, and the company will want to leverage that. IBM has already started down this path, but the major enterprise storage vendors — NetApp, EMC, and HDS — are all missing it.”

“HP and Dell have both seen their share of HPC servers increase as a direct result of IBM, previously the clear #1, selling its x86 server business to Lenovo. While Lenovo will continue to sell into the HPC market, the long disruption to the IBM sales process opened up the door for competition. Now HP and Dell are nearly deadlocked for the HPC server market share lead,” said Snell, adding he thinks the HP split will further energize HP’s HPC efforts.

Apollo is the product line underpinning the HPC cum Big Data gambit. Introduced last June, the Apollo line spans supercomputing to the datacenter. The 8000 and 6000 were first to market, targeting the high end. Last month, HP announced the 4000 (big data) and 2000 (entry level, datacenter) additions to the line.

Apollo Data CenterOutside the enterprise, HP has already racked up impressive wins. The first implementation of the Apollo platform (8000 machines) was by DOE’s National Renewable Energy Laboratory (NREL). NREL worked with Intel and HP to build Peregrine, a warm-water, liquid-cooled supercomputer. (The warm water is reused to heat the building after cooling the computer.)

Peregrine has 6,912 Intel Xeon E5-2670 “SandyBridge” processor cores, 24,192 Intel Xeon E5-2695v2 “IvyBridge” processor cores for a total of 31,104 Intel Xeon processor cores, providing a total of about 608 TeraFLOPS or Trillion floating point calculations per second. Peregrine also has 576 Intel Phi many-core co-processors with an aggregate performance of about 582 TeraFLOPS.  In total Peregrine is capable of 1.19 PetaFLOPS.

In April of this year, AGH University of Science and Technology in Krakow brought online its Prometheus supercomputer. Packing 1.7 Petaflops of peak computational performance, the HP-built machine is the most powerful supercomputer in the history of Poland and the world’s largest installation of HP Apollo 8000 servers. The 30 metric ton machine houses 1,728 HP Apollo 8000 InfiniBand-connected servers inside 15 racks.

High profile wins such as these, HP hopes, will create a buzz around the entire Apollo line including its more recent members targeted at Big Data and datacenter activities. Here is a brief snapshot of the Apollo platform:

  • Apollo 2000 is the entry offering. It’s available with up to four servers in 2U chassis, uses Intel Xeon ES-2600 processors, and supports as many as 24 drives per node. “You can use one as the head node and the other three as computes nodes,” says Mannel.
  • Apollo 4000 (three systems in the line, 4200, 4530, 4510) is aimed squarely at Big Data and the datacenter. Mannel noted, “It’s a Big Data Platform specifically used for matching compute with a lot of storage. It’s not a RAID box but it is a storage server with a number of different configurations.”
  • Apollo 6000 & 8000 as noted earlier target large-scale systems in technical and scientific computing. The users, according to Mannel, need hundreds to thousands of cores. Xeon E3 and E5 processors are used throughout the line and top models have two accelerator slots that support Xeon Phi.

Time will tell if this is the right product mix. Currently much of the enterprise market is sluggish. HP’s most recent financial results, released May 22, revealed Enterprise Group revenue was down 1% year over year with a 14.5% operating margin. Industry standard servers revenue was up 11%, but storage (8%), business critical systems (15%), networking (16%) and technology services (8%) were all down. Likewise, Enterprise services (16%), infrastructure technology outsourcing (20%), and application and business services revenue (8%) all declined.

Market fluctuations aside, the low hanging fruit would seem to be dual-use opportunities in large industries where HPC is already established such as the auto industry.

“Buy an auto today the thing itself is a big data producer. It uploads all this data, which gets collated and collected and analyzed from quality standpoint from a driver preference standpoint. Many of the big auto manufacturers have big data projects at the same time they are using their HPC resources for more of the standard structural analysis and crash analysis and fluid dynamics types of analysis,” said Mannel.

Making the HPC & Big Data gambit work for companies less experienced in HPC and with fewer computational resources will be challenging. For starters, adopting HPC isn’t easy. Complicated systems management, new programming techniques, tricky application software, power & space requirements, and unfamiliar architectures can quickly confound new-to-HPC users.

HP understands the challenges, contended Mannel, and has an effective strategy.

“One core bottleneck is that HPC has been so generic. What’s needed is a solution approach in which the right application with right configuration of the hardware and the right level of management and usability that make it acceptable to customers. I think that’s one area where the HPC market has struggled,” he said.

Within the HPC & Big Data GBU is a formal HPC Pursuit Group, which includes a team of applications engineers who work with end user customers, ISVs, and the open source community to ensure applications run well on HP hardware and for the customer’s specific application and workload. The group works with customers pre- and post sale to “make sure they are getting the performance they want.”

It’s also important to offer alternative access routes to HPC resources (e.g. cloud) said Mannel both for pilot programs and production environments.

“We provide for a number of very large customers as well as smaller customers the ability to essentially get HPC on tap. If they don’t want to build their own HPC datacenter because of space constraints or lack of expertise, we’ll set up customers with access to HPC resources we control. It can be done on or off customer premise; they just pay a monthly bill,” Mannel said.

For now, HP’s key target markets are pretty vannila: 1) Oil & Gas, a long-term HPC user and frequent adopter leading advances; 2) Manufacturing, “[HP] has expertise in computing and engineering work which tends to be engineering simulation more than anything else;” 3) Financial services, again no surprise; and 4) Life sciences, which “is an emerging market for us. It’s a place where we are going to put more investment and expertise over time. It was a past focus but we are recommitting to it.”

Currently x86 technology dominates the HPC portfolio but its preeminence is being slowly chipped away. In terms of balancing the portfolio by incorporating various technologies, there is a shift going on – not that x86 is less important but that other technologies are also becoming important and taking a greater share.

“That’s definitely fair,” said Mannel. “You’re seeing a massive variety of different technologies and techniques coming onboard. Here’s an example. Nearly ten years ago I led a big effort around using FPGAs for HPC. We had a little success but in the end it was only for a few defense applications. It was just hard to program FPGAs.

“Come forward ten years and I’ve talked to some service providers who are swearing by using FPGAs. They are saying, ‘We did the [programming] work, are getting acceleration, and are very happy with the results.’

“I think that’s a really common experience. Now there’s GPUs out there, Intel Phi, high-performance interconnects, new programming approaches. It’s all coming about because just waiting for the latest rev of the [next Intel] chip is not creating the level of performance, price performance, and performance per watt that customers are expecting,” Noted Mannel

Intel haters should not get giddy. No sea change is expected soon, certainly not at HP, but change is now part of the technology selection conversation. An HP example is its Moonshot system aimed at cloud and more traditional datacenter functionality. Moonshot has a power-stingy system-on-chip ARM processor in its arsenal. Along with other technology, the ARM processor allows Moonshot to have a small space and small power footprint.

“I use a phrase, ‘[The] right compute at the right time for right data.’ For a long time, the x86 was just that. You could get a very wide range of applications that ran very well on x86 architecture. Now you are starting to see with some of these new applications that you can get better performance using different technologies. We tend to invest in new technologies that fit our capabilities as a company, our drivers, and also offer strong value proposition for customers.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

What’s New in Computing vs. COVID-19: Fugaku, Congress, De Novo Design & More

July 2, 2020

Supercomputing, big data and artificial intelligence are crucial tools in the fight against the coronavirus pandemic. Around the world, researchers, corporations and governments are urgently devoting their computing reso Read more…

By Oliver Peckham

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time last year, IBM announced open sourcing its Power instructio Read more…

By John Russell

HPC Career Notes: July 2020 Edition

July 1, 2020

In this monthly feature, we'll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it's a promotion, new company hire, or even an accolade, we've got Read more…

By Mariana Iriarte

Supercomputers Enable Radical, Promising New COVID-19 Drug Development Approach

July 1, 2020

Around the world, innumerable supercomputers are sifting through billions of molecules in a desperate search for a viable therapeutic to treat COVID-19. Those molecules are pulled from enormous databases of known compoun Read more…

By Oliver Peckham

HPC-Powered Simulations Reveal a Looming Climatic Threat to Vital Monsoon Seasons

June 30, 2020

As June draws to a close, eyes are turning to the latter half of the year – and with it, the monsoon and hurricane seasons that can prove vital or devastating for many of the world’s coastal communities. Now, climate Read more…

By Oliver Peckham

AWS Solution Channel

Maxar Builds HPC on AWS to Deliver Forecasts 58% Faster Than Weather Supercomputer

When weather threatens drilling rigs, refineries, and other energy facilities, oil and gas companies want to move fast to protect personnel and equipment. And for firms that trade commodity shares in oil, precious metals, crops, and livestock, the weather can significantly impact their buy-sell decisions. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

Hyperion Forecast – Headwinds in 2020 Won’t Stifle Cloud HPC Adoption or Arm’s Rise

June 30, 2020

The semiannual taking of HPC’s pulse by Hyperion Research – late fall at SC and early summer at ISC – is a much-watched indicator of things come. This year is no different though the conversion of ISC to a digital Read more…

By John Russell

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time Read more…

By John Russell

Hyperion Forecast – Headwinds in 2020 Won’t Stifle Cloud HPC Adoption or Arm’s Rise

June 30, 2020

The semiannual taking of HPC’s pulse by Hyperion Research – late fall at SC and early summer at ISC – is a much-watched indicator of things come. This yea Read more…

By John Russell

Racism and HPC: a Special Podcast

June 29, 2020

Promoting greater diversity in HPC is a much-discussed goal and ostensibly a long-sought goal in HPC. Yet it seems clear HPC is far from achieving this goal. Re Read more…

Top500 Trends: Movement on Top, but Record Low Turnover

June 25, 2020

The 55th installment of the Top500 list saw strong activity in the leadership segment with four new systems in the top ten and a crowning achievement from the f Read more…

By Tiffany Trader

ISC 2020 Keynote: Hope for the Future, Praise for Fugaku and HPC’s Pandemic Response

June 24, 2020

In stark contrast to past years Thomas Sterling’s ISC20 keynote today struck a more somber note with the COVID-19 pandemic as the central character in Sterling’s annual review of worldwide trends in HPC. Better known for his engaging manner and occasional willingness to poke prickly egos, Sterling instead strode through the numbing statistics associated... Read more…

By John Russell

ISC 2020’s Student Cluster Competition Winners Announced

June 24, 2020

Normally, the Student Cluster Competition involves teams of students building real computing clusters on the show floors of major supercomputer conferences and Read more…

By Oliver Peckham

Hoefler’s Whirlwind ISC20 Virtual Tour of ML Trends in 9 Slides

June 23, 2020

The ISC20 experience this year via livestreaming and pre-recordings is interesting and perhaps a bit odd. That said presenters’ efforts to condense their comments makes for economic use of your time. Torsten Hoefler’s whirlwind 12-minute tour of ML is a great example. Hoefler, leader of the planned ISC20 Machine Learning... Read more…

By John Russell

At ISC, the Fight Against COVID-19 Took the Stage – and Yes, Fugaku Was There

June 23, 2020

With over nine million infected and nearly half a million dead, the COVID-19 pandemic has seized the world’s attention for several months. It has also dominat Read more…

By Oliver Peckham

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers


Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This