HP Targets HPC with New Approach to Water Cooling

By Nicole Hemsoth

June 10, 2014

HP has announced a new family of high performance computing systems that target a balance between high density, energy efficiency, and raw performance. The line, called “HP Apollo” is divided in half for key workloads and needs, with the air-cooled Apollo 6000 system aimed at enterprise users and the liquid-cooled Apollo 8000 focused on large-scale supercomputing sites.

As many remember, last year we followed the announcement of the new Peregrine supercomputer at the National Renewable Energy Laboratory (NREL). The warm water-cooled system set the bar for efficiency, but little did we know then that HP would roll out an entire line to replicate that success. HP saw the value of the approach while completing the system for NREL and has since learned lessons about expanding the same system for both new and existing air-cooled datacenters. They’re hoping the balanced push of high density and big energy savings will speak both to the national lab set and commercial datacenter operators who don’t have the luxury of, say a Facebook, to build as big as they wish with the comfort of cheap power that they can blow back into the sky as waste heat.

The Apollo system features a scalable rack design that allows for 144 servers in a rack, which HP says means “four times the teraflops per rack compared to air-cooled designs.” HP’s Ed Turkel said that this translates into the elimination of over 3.800 tons of carbon dioxide waster from a datacenter over the course of a year. Further, the Apollo 8000 features a patented, novel warm water cooling system that HP’s Ed Turkel provides “liquid cooling without the risk.” HP’s approach avoids the use of dripless connectors and other safeguards against water touching any of the components. The cooled components release hot water, which can be recirculated to provide building heat. In fact, one of the prime sites to see the Apollo 8000 line in action is where it was conceptualized—at the NREL Peregrine supercomputer site.

The Apollo 8000 at its base starting line consists of an Apollo 8000 standard-sized rack and the Apollo 8000 iCDU rack.

HPSpecs1

These are outfitted with the HP Proliant XL730f server and HP’s InfiniBand switch.

HPSpecs2

As Turkel told us, when NREL set forth designing the type of system that would showcase their position as both an energy efficient research leader as well as practitioner of efficient practices, they knew that part of their design would incorporate warm water cooling. This initial RFP set HP’s development wheels in motion as the team tried to find a way to integrate risk-free, high-density water-cooled supercomputing capabilities at NREL within space and budget limitations.

Luckily, NREL was able to design the center from the ground up to accommodate the plumbing and other infrastructure to support both a water cooled supercomputer and the ability to carry the waste heat in water form throughout the building, but Turkel says that his team is confident that retrofitting an air-cooled datacenter for the same environment NREL has is also practical and affordable, especially after their work in making some of the piping and other components more “modular” in nature so user facilities can circumvent some of the custom pipe cutting that had to go on at the first NREL site.

Turkel said that one testament to the success of the datacenter waste heat’s potential to heat the area is the fact that the sidewalk leading up to the NREL supercomputing site is always free of ice and snow during the cold Colorado winter. NREL extended the pipes that carry heat from the servers to just under the pavement.

But for NREL, the project means more than recycling supercomputer heat—it has lead to close to a million dollars in energy savings, both in heating costs and in overall efficiency of the supercomputers themselves. Further, since the components run at a stable temperature, they’re able to operate their Xeon Phi in ongoing turbo mode.

This is a huge improvement in how NREL has designed and implemented new supercomputing facilities. Steve Hammond, director of Computational Sciences at NREL, compared the current trend of air cooling to setting a glass of lemonade on a kitchen counter during a hot summer day and keeping it cold by cranking up the air conditioning in the room. “It’s incredibly wasteful—it just doesn’t make sense,” he told us.

“For us, warm water cooling was the key approach to making the efficiency targets work. As a cooling medium, liquids have about 1,000 times the efficiency of air,” said Hammond. “A juice glass full of water has the cooling capacity of a room full of air. And the pump energy needed to move that juice glass of water, to eject the heat from the system, is less than the fan energy needed to move that room full of air—much less.”

A great deal of the decision to move to hot water cooling was fed by existing problems, both because of efficiency or safety, with current solutions on the liquid and air-cooling fronts. As Hammond explained, making the decision to circulate past the air cooling decision was simple because the inefficiencies and waste are clear.

While many of the hyperscale datacenter giants tend to use air cooling, their greenfield facilities are placed where space and power are cheap and plentiful. Although certainly not the most efficient or carbon-aware, many HPC datacenters, including the new high performance computing facility where the Peregrine supercomputer is housed at NREL, are limited all around—space is a precious commodity and the thought of wasting all of the heat generated by their constant research by blowing it up into the sky would be completely counter to their center’s mission of “practicing what is preached” in terms of energy research.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

HPC in O&G: Deep Sea Drilling – What Happens Now   

June 4, 2020

At the beginning of March I attended the Rice Oil & Gas HPC conference in Houston. That seems a long time ago now. It’s a great event where oil and gas specialists join with compute veterans and the discussion tell Read more…

By Rosemary Francis

NCSA Wades into Post-Blue Waters Era with Delta Supercomputer

June 3, 2020

NSF has awarded the National Center for Supercomputing Applications (NCSA) $10 million for its next supercomputer - named Delta – “which will kick-start NCSA’s next generation of supercomputers post-Blue Waters,” Read more…

By John Russell

Dell Integrates Bitfusion for vHPC, GPU ‘Pools’

June 3, 2020

Dell Technologies advanced its hardware virtualization strategy to AI workloads this week with the introduction of capabilities aimed at expanding access to GPU and HPC services via its EMC, VMware and recently acquired Read more…

By George Leopold

Supercomputers Streamline Prediction of Dangerous Arrhythmia

June 2, 2020

Heart arrhythmia can prove deadly, contributing to the hundreds of thousands of deaths from cardiac arrest in the U.S. every year. Unfortunately, many of those arrhythmia are induced as side effects from various medicati Read more…

By Staff report

Indiana University to Deploy Jetstream 2 Cloud with AMD, Nvidia Technology

June 2, 2020

Indiana University has been awarded a $10 million NSF grant to build ‘Jetstream 2,’ a cloud computing system that will provide 8 aggregate petaflops of computing capability in support of data analysis and AI workload Read more…

By Tiffany Trader

AWS Solution Channel

Join AWS, Univa and Intel for This Informative Session!

Event Date: June 18, 2020

More enterprises than ever are turning to HPC cloud computing. Whether you’re just getting started, or more mature in your use of cloud, this HPC Cloud webinar is an excellent opportunity to gain valuable insights and knowledge to help accelerate your HPC cloud projects. Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been instrumental to AMD’s datacenter market resurgence. Nanomet Read more…

By Doug Black

NCSA Wades into Post-Blue Waters Era with Delta Supercomputer

June 3, 2020

NSF has awarded the National Center for Supercomputing Applications (NCSA) $10 million for its next supercomputer - named Delta – “which will kick-start NCS Read more…

By John Russell

Indiana University to Deploy Jetstream 2 Cloud with AMD, Nvidia Technology

June 2, 2020

Indiana University has been awarded a $10 million NSF grant to build ‘Jetstream 2,’ a cloud computing system that will provide 8 aggregate petaflops of comp Read more…

By Tiffany Trader

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

COVID-19 HPC Consortium Expands to Europe, Reports on Research Projects

May 28, 2020

The COVID-19 HPC Consortium, a public-private effort delivering free access to HPC processing for scientists pursuing coronavirus research – some utilizing AI Read more…

By Doug Black

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

IBM Boosts Deep Learning Accuracy on Memristive Chips

May 27, 2020

IBM researchers have taken another step towards making in-memory computing based on phase change (PCM) memory devices a reality. Papers in Nature and Frontiers Read more…

By John Russell

Hats Over Hearts: Remembering Rich Brueckner

May 26, 2020

HPCwire and all of the Tabor Communications family are saddened by last week’s passing of Rich Brueckner. He was the ever-optimistic man in the Red Hat presiding over the InsideHPC media portfolio for the past decade and a constant presence at HPC’s most important events. Read more…

Nvidia Q1 Earnings Top Expectations, Datacenter Revenue Breaks $1B

May 22, 2020

Nvidia’s seemingly endless roll continued in the first quarter with the company announcing blockbuster earnings that exceeded Wall Street expectations. Nvidia Read more…

By Doug Black

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers

SC 2019 Virtual Booth Video Tour

AMD
AMD
ASROCK RACK
ASROCK RACK
AWS
AWS
CEJN
CJEN
CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
IBM
IBM
MELLANOX
MELLANOX
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
SIX NINES IT
SIX NINES IT
VERNE GLOBAL
VERNE GLOBAL
WEKAIO
WEKAIO

Contributors

Tech Conferences Are Being Canceled Due to Coronavirus

March 3, 2020

Several conferences scheduled to take place in the coming weeks, including Nvidia’s GPU Technology Conference (GTC) and the Strata Data + AI conference, have Read more…

By Alex Woodie

Exascale Watch: El Capitan Will Use AMD CPUs & GPUs to Reach 2 Exaflops

March 4, 2020

HPE and its collaborators reported today that El Capitan, the forthcoming exascale supercomputer to be sited at Lawrence Livermore National Laboratory and serve Read more…

By John Russell

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Cray to Provide NOAA with Two AMD-Powered Supercomputers

February 24, 2020

The United States’ National Oceanic and Atmospheric Administration (NOAA) last week announced plans for a major refresh of its operational weather forecasting supercomputers, part of a 10-year, $505.2 million program, which will secure two HPE-Cray systems for NOAA’s National Weather Service to be fielded later this year and put into production in early 2022. Read more…

By Tiffany Trader

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This