HPCwire: Rising Up to the Cloud

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

Leading HPC
Solution Providers

HPCwire >> Blogs

Blog: From the Editor

From the Editor | Main Blog Index

January 11, 2008

Rising Up to the Cloud

In this week's issue, supercomputing veteran and Microsoft newbie Dan Reed writes eloquently about two topics close to our HPC-loving hearts: cyberinfrastructure funding for big science and the promise of HPC outsourcing.

First, Reed laments the failure of the recently passed FY2008 Omnibus Appropriations Bill to allocate enough money to fulfill the ambitions of the last year's COMPETES Act. The 3,500-page bill has been widely criticized as an unsavory combination of pork-laden earmarks and Congressional capitulation to the administration. In some cases, the funding for big science doesn't even keep pace with inflation, effectively killing COMPETES' goal of doubling money for the NSF, NIST and DOE Office of Science over the next seven years.

In this new economic reality, Reed also wonders if the research community should start looking for ways to outsource a much greater share of their computing operations to large-scale commercial IT entities. Writes Reed:

"I view this as the research computing equivalent of the fabless semiconductor firm, which focuses on design innovation and outsources chip fabrication to silicon foundries. This lets each group -- the designers and the foundry operators -- do what they do best and at the appropriate scale. Most of us operate HPC facilities out of necessity, not out of desire. They are, after all, the enablers of discovery, not the goal."

That notion is also being reflected in the commercial HPC realm, where some users are wondering if utility computing, embodied by the new moniker "cloud computing," will deliver on the promises grid computing made over a decade ago. John West recently penned a few thoughts about outsourcing HPC, noting that the decreasing cost of FLOPS and the increasing costs of system deployment and IT operations are powerful incentives to move toward a utility model.

Developments along these lines seem to be moving rather quickly in the broader computing community. In 2007, computing giants like IBM, Google, Yahoo, Amazon, and even Microsoft, started to make earnest plans for this brave new world. Web-delivered services and web-based applications are all the rage and poised to become the basis of the next general-purpose computing platform. Once the cloud starts swallowing business and consumer desktop applications, there will be no stopping this trend.

Nicholas Carr's new book, "The Big Switch: Rewiring the World, from Edison to Google" describes a world where utility computing is quickly reshaping the IT landscape. Carr, who once called the PC "an anachronism waiting to happen," believes companies like Google, Salesforce.com and Amazon are in the best position to take advantage of this paradigm shift, but that for legacy companies like Dell and Microsoft, it's going to be a rougher ride.

Carr's thrust is that computing has become a commodity, just as electricity did in the early 20th century. At that time, a few entrepreneurs realized that electricity could be generated much more cheaply from a large-scale central facility, rather than within individual businesses (users). Electric utility companies were formed and businesses ditched their own power generators and switched over to the more efficient grid.

Today, the cloud represents the nascent computing grid of the 21st century. Businesses that have maintained their own IT departments would willingly outsource their computing if it could be done less expensively elsewhere. While today's CIOs might be somewhat resistant to turning their company's datacenter into an exercise room, the attraction of cheap, reliable computing would be irresistible.

But Carr's analogy to the power grid can only be taken so far. Electricity is a one of the simplest of commodities. (Basically the producers and users just have to agree on a few standards, like voltage and frequency.) Information production, i.e., computing, is much more diverse, encompassing everything from word processing to video streaming to nuclear weapons simulation. Different types of computing suggest the need for heterogenous computing environments, which many not be practical for a utility datacenter. Also, unlike electricity, computing usually assumes some level of security and privacy -- something that is difficult to achieve in mixed-use, off-site facilities.

A better analogy for computing may be food production. When food became a commodity, agribusiness conglomerates took over and replaced lots of family farms with much larger, more efficient "factory farms." Today, crops like wheat and soybeans are typically grown on multi-hundred acre land parcels. But not all food products are easily commoditized. Specialty fruits, vegetables, and organic products don't usually lend themselves very well to large-scale production. According to the U.S. Department of Agriculture about a quarter of farm revenue is still generated on family farms. Many of these farms are focusing on these specialty items and have formed cooperative arrangements in order to remain economically viable.

In that sense, high performance computing may be more analogous to an enterprise like a winery. While large-scale wine production is certainly present, a significant number of growers have banded together on a regional basis to produce higher value products: fine varietal wines. In the latter case, individual wineries operate on a much smaller scale than a typical agribusiness enterprise. Something similar is actually taking place in non-commercial HPC, where regional grids, like TeraGrid or EGEE, or more loosely-coupled organizations, like the U.S. DOE labs or Europe's DEISA supercomputing consortium, have formed alliances to share computing resources.

It may be the case that non-commercial supercomputing will stick with this model, while most commercial high performance computing will eventually end up in the cloud. But I can't help but think HPC will be one of the last adopters of the utility model. The computing cloud is being built on top of the Internet -- a high-latency, low-performance computational infrastructure designed mainly for data storage and distribution, not computation, and certainly not scientific computation. It will be years before even desktop and mainstream enterprise computing are incorporated. The cloud is going to need to develop some serious thunderheads to suck in high performance computing.

-----

As always, comments about HPCwire are welcomed and encouraged. Write to me, Michael Feldman, at editor@hpcwire.com.

Posted by Michael Feldman - January 11 @ 12:00AM

Discussion

There are 0 discussion items posted.

Join the Discussion

You must be a registered user in order to comment on HPCwire stories.

Members enjoy:

	Access to Special Content, including Podcasts, Webcasts, and Whitepapers and more!
	Ability to take an active role in the discussions that are shaping the HPC technology discipline!
	Special offers available only to HPCwire members!

Become a Registered User Today!

Registered Users Log in Here to Comment

Email Address:	Password (case sensitive)

Remember me	Forgot Password?

FREE Download: "Going Parallel - An Implementation Guide"
Breakthrough performance for MATLAB®, Python and other desktop apps... Get 100X speedups, with less than 10% of the development time. Focus is on enabling familiar desktop tools to virtually execute on parallel servers, clusters, and grids.

Podcast: John West talks with John Lee, Appro’s VP of Advanced Technology Solutions at SC08
Learn more about Appro, what they showcased at SC08 this year, and where the company is headed. Also joining the conversation was Graeme Hackland, the IT manager for the Renault F1 team, one of Appro's big HPC customers.

Michael Feldman

Michael Feldman is the editor of HPCwire.

More Michael Feldman

Feature Articles

A Framework for Interfacing Configurable Hardware Accelerators

For all the benefits claimed by hardware acceleration, from exponential performance improvements to massive power and space savings, most of these benefits focus on what can be accomplished with little detail on how to accomplish it. Hardware acceleration always seems to have the implied acronym DIY (Do It Yourself).
Read More...

Santa's HPC Woes

You thought you had it hard. What if all of your business, with a worldwide customer base, occurred in the midnight hours of a single day towards the end of December?
Read More...

Baby, It's Cold Outside...Let's Calculate Something

Argonne National Labs is part of the Department of Energy, so it's not exactly surprising to learn that they are actively looking for ways to reduce energy use. But using Chicago's cold winters to save $25,000 a month on cooling costs for the supers in their Leadership Computing Facility is, well, cool.
Read More...

Read more HPCwire features...

Top Headlines

How 100 Gigabit Ethernet Markets Will Differ from 10

Jan 07 | Seeking Alpha | The advent of 10 Gigabit Ethernet created major opportunities for equipment startups, but this may not be the case for the future 40 and 100 Gigabit Ethernet markets. Read more...

Virtual Product Development Gaining Traction

Jan 05 | Design News | While manufacturers may never be able to completely avoid physical prototyping, best-in-class players are continuing to expand their use of virtual product development. Read more...

C-DAC Initiatives for NE Region

Jan 05 | CXOtoday.com | The Centre for Development of Advanced Computing (C-DAC) has inaugurated its PARAM Sheersh Supercomputing Facility at North Eastern Hill University in India. Read more...

China-Made Supercomputer to be Installed in Shanghai

Jan 02 | People's Daily Online | A 200 teraflop Chinese supercomputer is scheduled to be installed in Shanghai in April. Read more...

Finding Huge Potential in Rocks’ Tiniest Cracks

Dec 31 | Houston Chronicle | A Houston-based company is using supercomputing power to reveal how gas and oil flows through underground rocks. Read more...

Read more headlines...

Featured Whitepapers

Star-P: Parallel Computing Without Parallel Programming

Dec 15 | | Engineers, scientists, and other domain experts depend on the productivity enabled by very high-level language (VHLL) tools like MATLAB® and Python. However, as datasets grow larger and programs get more sophisticated, ordinary desktop computers can no longer keep up. The paper explores how to run VHLL programs on high-performance platforms without low-level reprogramming. Work with large datasets and complex algorithms without sacrificing ease of use or reducing productivity.

Virtual Wind Tunnel: Building the ING Renault F1 Team Aerodynamics Research Supercomputer

Dec 02 | | Learn about Appro’s experience providing a supercomputer for the use of Computational Fluid Dynamics at the ING Renault F1 Team’s technical centre in the United Kingdom. The Appro Xtreme-X™ Supercomputer provides a balanced HPC architecture for scalable performance, power and cooling efficiency, and high availability computing in a redundant and manageable framework.

View the White Paper Library

Multimedia

Webcast: HPC Development Solutions: Sun Studio & Sun HPC ClusterTools

Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.

Webcast: Dell Expands HPC Access and Adoption with Intel Cluster Ready Program

Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell

Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.

Video White Paper: Architecting a Better Network Storage Solution

BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.