Visit additional Tabor Communication Publications
July 07, 2006
It's been an "early" summer here in San Diego this year. Our typical Pacific Ocean marine layer, which normally keeps the area naturally air-conditioned in May, June and most of July has failed us this year. Temperatures have soared into the nineties in recent weeks and ocean temperatures are already in the seventies. I was reminded of the unusual warm weather as I worked on my computer over the July 4th weekend, with the constant whir of the cooling fan in the background.
I'm not bringing this up to remind everyone about global warming. There's another "inconvenient truth" worth talking about -- the collision between rising energy costs and increasing energy consumption by ever more powerful computers. Recent articles in this publication and elsewhere have discussed the problems associated with powering and cooling high-end computers. In fact, it's hard to find an HPC story that doesn't mention the power crisis in supercomputing.
Last week's article on the limits of high performance computing, by John Gustafson of ClearSpeed, illustrates how energy costs have started to dominate overall computing expenditures. He points out that Google's cost of running its server farms are its biggest line item expense. This probably explains why the company is constructing an enormous (and mysterious) computing facility on the banks of the Columbia River, where access to cheap hydroelectric power has apparently acted as a powerful incentive. Oak Ridge National Laboratory's buildup of its supercomputing infrastructure over the next few years, culminating in a petaflops system in 2008, will certainly benefit from its proximity to the energy resources of the Tennessee Valley Authority.
Gustafson's example of the 5 cents/kilowatt-hours energy cost at the Pacific Northwest National Laboratory versus 23 cents/kilowatt-hours at the Maui High Performance Computing Center is a powerful example of how economic geography is affecting the price of computing. Unfortunately, Maui is doubly penalized. Not only are energy costs much higher there, but the constantly warm climate adds to the overall cooling load of the facility and the computers. The increasing importance of electricity costs points to a new reality that will influence how and where supercomputers may be deployed in the future.
In this week's feature interview with Steve Scott, CTO of Cray, he discusses the supercomputing power consumption problem as well. Scott talks about three ways to address the problem: multi-core architectures, specialized processors that use less silicon per computation (for example, streaming processors, vector processors and FPGAs), and intelligent chip-level power management. Certainly the industry is headed down all three paths and each approach promises a significant impact on overall energy consumption.
The recent CTWatch Quarterly article, "Designing and Supporting High-end Computational Facilities," written by Ralph Roskies (Pittsburgh Supercomputing Center) and Thomas Zacharia (Oak Ridge National Laboratory), devotes a good deal of attention to energy issues. They write:
"Power consideration begins with the ability of the utility company to deliver adequate power to the site from its substations. Be prepared for a shocked reaction from your utility company the first time you call and make your request, especially if you have never done this before."
In some areas of the country, like parts of California, I'm guessing that the request for an extra megawatt or two from the local utility company may be problematic. Energy-poor countries, like Japan, may have even greater limitations. For example, the recently installed Tokyo Tech TSUBAME supercomputer had to meet very strict power consumption requirements.
Roskies and Zacharia continue:
"The power costs must not only take into account the power needs of the computer, but also the cost of the cooling. As a rule of thumb, multiply the power consumption of the system alone by 35-40 percent to estimate the additional power consumption of the required cooling. Today's rates for power vary substantially over the country, ranging from under 3 cents/kwh to over 10 cents/kwh."
Hmm... I guess they haven't been to Hawaii recently.
But this brings up a bigger question. What portion of our national energy budget should we expect to allocate for computer infrastructure as we evolve toward an Information Society? Some projections have cyberinfrastructure taking as much as 50 percent of our total energy use within 20 years. But a 2002 RAND Corporation report, titled "Electricity requirements for a digital society," predicts less than five percent by 2020.
In the RAND study, the conclusion is that the real energy limitations have to do with quality and reliability:
"Increasing use of the Internet and other information and communications technologies (ICTs) marks a U.S. transition toward a 'digital society' that may profoundly affect electricity supply, demand and delivery. RAND developed four 20-year scenarios of ICT evolution (2001-2021) for the U.S. Department of Energy and assessed their implications for future U.S. electricity requirements. Increased power consumption by ICT equipment is the most direct and visible effect, but not necessarily the most important. Over time, the effects that ICTs have on energy management, e-commerce, telework, and related trends will likely be much more consequential. Even large growth in the deployment and use of digital technologies will only modestly increase U.S. electricity use over the next two decades. The more pressing concern for an emerging digital society will be how to provide the higher-quality and more-reliable power that ICTs demand."
But this still leaves me wondering. As our ancestors evolved into humans -- "information beings" so to speak -- the amount of energy our brains used, proportional to the rest of our bodies, continued to rise. Today our brains consume 20 percent of our energy while at rest. It seems reasonable to me that an economy based on information processing and knowledge discovery would also demand a bigger cut of the energy pie for its intellectual hardware.
Meanwhile, it looks like another warm weekend for San Diego. Maybe this time I'll just shut down the computer and head to the beach. Even the Information Society has to take a break once in awhile.
As always, comments about HPCwire are welcomed and encouraged. Write to me, Michael Feldman, at firstname.lastname@example.org.
Posted by Michael Feldman - July 06, 2006 @ 9:00 PM, Pacific Daylight Time
Michael Feldman is the editor of HPCwire.
No Recent Blog Comments
In quieter times, sounding the bell of funding big science with big systems tends to resonate further than when ears are already burning with sour economic and national security news. For exascale's future, however, the time could be ripe to instill some sense of urgency....
In a recent solicitation, the NSF laid out needs for furthering its scientific and engineering infrastructure with new tools to go beyond top performance, Having already delivered systems like Stampede and Blue Waters, they're turning an eye to solving data-intensive challenges. We spoke with the agency's Irene Qualters and Barry Schneider about..
Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
May 23, 2013 |
The study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
May 22, 2013 |
At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.