The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
From the Editor | Main Blog Index
January 11, 2008
In this week's issue, supercomputing veteran and Microsoft newbie Dan Reed writes eloquently about two topics close to our HPC-loving hearts: cyberinfrastructure funding for big science and the promise of HPC outsourcing.
First, Reed laments the failure of the recently passed FY2008 Omnibus Appropriations Bill to allocate enough money to fulfill the ambitions of the last year's COMPETES Act. The 3,500-page bill has been widely criticized as an unsavory combination of pork-laden earmarks and Congressional capitulation to the administration. In some cases, the funding for big science doesn't even keep pace with inflation, effectively killing COMPETES' goal of doubling money for the NSF, NIST and DOE Office of Science over the next seven years.
In this new economic reality, Reed also wonders if the research community should start looking for ways to outsource a much greater share of their computing operations to large-scale commercial IT entities. Writes Reed:
"I view this as the research computing equivalent of the fabless semiconductor firm, which focuses on design innovation and outsources chip fabrication to silicon foundries. This lets each group -- the designers and the foundry operators -- do what they do best and at the appropriate scale. Most of us operate HPC facilities out of necessity, not out of desire. They are, after all, the enablers of discovery, not the goal."
That notion is also being reflected in the commercial HPC realm, where some users are wondering if utility computing, embodied by the new moniker "cloud computing," will deliver on the promises grid computing made over a decade ago. John West recently penned a few thoughts about outsourcing HPC, noting that the decreasing cost of FLOPS and the increasing costs of system deployment and IT operations are powerful incentives to move toward a utility model.
Developments along these lines seem to be moving rather quickly in the broader computing community. In 2007, computing giants like IBM, Google, Yahoo, Amazon, and even Microsoft, started to make earnest plans for this brave new world. Web-delivered services and web-based applications are all the rage and poised to become the basis of the next general-purpose computing platform. Once the cloud starts swallowing business and consumer desktop applications, there will be no stopping this trend.
Nicholas Carr's new book, "The Big Switch: Rewiring the World, from Edison to Google" describes a world where utility computing is quickly reshaping the IT landscape. Carr, who once called the PC "an anachronism waiting to happen," believes companies like Google, Salesforce.com and Amazon are in the best position to take advantage of this paradigm shift, but that for legacy companies like Dell and Microsoft, it's going to be a rougher ride.
Carr's thrust is that computing has become a commodity, just as electricity did in the early 20th century. At that time, a few entrepreneurs realized that electricity could be generated much more cheaply from a large-scale central facility, rather than within individual businesses (users). Electric utility companies were formed and businesses ditched their own power generators and switched over to the more efficient grid.
Today, the cloud represents the nascent computing grid of the 21st century. Businesses that have maintained their own IT departments would willingly outsource their computing if it could be done less expensively elsewhere. While today's CIOs might be somewhat resistant to turning their company's datacenter into an exercise room, the attraction of cheap, reliable computing would be irresistible.
But Carr's analogy to the power grid can only be taken so far. Electricity is a one of the simplest of commodities. (Basically the producers and users just have to agree on a few standards, like voltage and frequency.) Information production, i.e., computing, is much more diverse, encompassing everything from word processing to video streaming to nuclear weapons simulation. Different types of computing suggest the need for heterogenous computing environments, which many not be practical for a utility datacenter. Also, unlike electricity, computing usually assumes some level of security and privacy -- something that is difficult to achieve in mixed-use, off-site facilities.
A better analogy for computing may be food production. When food became a commodity, agribusiness conglomerates took over and replaced lots of family farms with much larger, more efficient "factory farms." Today, crops like wheat and soybeans are typically grown on multi-hundred acre land parcels. But not all food products are easily commoditized. Specialty fruits, vegetables, and organic products don't usually lend themselves very well to large-scale production. According to the U.S. Department of Agriculture about a quarter of farm revenue is still generated on family farms. Many of these farms are focusing on these specialty items and have formed cooperative arrangements in order to remain economically viable.
In that sense, high performance computing may be more analogous to an enterprise like a winery. While large-scale wine production is certainly present, a significant number of growers have banded together on a regional basis to produce higher value products: fine varietal wines. In the latter case, individual wineries operate on a much smaller scale than a typical agribusiness enterprise. Something similar is actually taking place in non-commercial HPC, where regional grids, like TeraGrid or EGEE, or more loosely-coupled organizations, like the U.S. DOE labs or Europe's DEISA supercomputing consortium, have formed alliances to share computing resources.
It may be the case that non-commercial supercomputing will stick with this model, while most commercial high performance computing will eventually end up in the cloud. But I can't help but think HPC will be one of the last adopters of the utility model. The computing cloud is being built on top of the Internet -- a high-latency, low-performance computational infrastructure designed mainly for data storage and distribution, not computation, and certainly not scientific computation. It will be years before even desktop and mainstream enterprise computing are incorporated. The cloud is going to need to develop some serious thunderheads to suck in high performance computing.
-----
As always, comments about HPCwire are welcomed and encouraged. Write to me, Michael Feldman, at editor@hpcwire.com.
Posted by Michael Feldman - January 11 @ 12:00AM
(Digg, Technorati, more)
PGI Accelerator™ Fortran 95/03 and C99 compilers for x64+NVIDIA
Accelerate applications on x64+GPU platforms by adding OpenMP-like compiler directives to existing Fortran and C programs. Available now for Linux, MacOS and Windows. Download a free 15 day trial.
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
Michael Feldman is the editor of HPCwire.
More Michael Feldman
Compairson to Core i7-980X by rsingle
HPC? not so much by ewahl
Re: IBM and HPC by truly64
HPC = servers but a lot more by lawries
Multi core deployment becomes a memory game by truly64
Re: Venture Capital Drought? Not So Much. by Ron Van Holst
Re: Podcast: Cray Awarded Defense Deal; SGI Makes Storage Buy; IBM Invents New Algorithm by Nastyanna
Painful Truth by jeffrey.mcallister
SGI = graphics + HPC by johnbarr
HPC = servers but a lot more by truly64
Oracle SPARC != Fujitsu SPARC by Alan M. Feldstein
Sun & HPC != Oracle & HPC by Merblich
a third vendor for lossless low latency 10GbE fabric by lee.fisher@hp.com
Response to GAH by KevinButerbaugh
Response to KevinButerbaugh by GAH
Response to KevinButerbaugh by GAH
Response to GAH by KevinButerbaugh
Response to bdrupp by KevinButerbaugh
Climate Crisis and Exaflops by bdrupp
Climate Crisis and Exaflops by John Hules
Climate Crisis and Exaflops by GAH
Climate Crisis by KevinButerbaugh
IBM "Brain Simulation" article is not properly presented. by Merritt
563 out of 1206 by vvolkov
Little Iron by gadunk
At least it's not "cloud" by KevinButerbaugh
Native QPI Interface? by commike
Mmmmmm by hellcats
New transistorized IC chip scales. by symmecon
Itanium at IDF by Alan M. Feldstein
Communication time by jnapper
"The financial meltdown and computing" by donpellegrino
Human Models by mdgabriel
High-End SPARC Chip for Scientific Applications by Alan M. Feldstein
RapidMind by Mr LolO
Rapidmind by dminor
Longer run times by JohnWest
re: Algo trading Angst by jshore
Results of Testing by in_the_crease
C-DAC announces plans for a petaflop system; IBM researchers are working on vertical integration techniques to extend Moore's Law another 15 years. We recap those stories and more in our weekly wrapup.
Read More...
The Moscow State University supercomputer, Lomonosov, has been selected for a high-performance makeover, with the goal of tripling its processing power to achieve petaflop-level performance in 2010. T-Platforms, who developed and manufactured the supercomputer, is the odds-on favorite to lead the project.
Read More...
Right on schedule, Intel has launched its Xeon 5600 processors, codenamed "Westmere EP." The 5600 represents the 32nm sequel to the Xeon 5500 (Nehalem EP) for dual-socket servers. Intel is touting better performance and energy efficiency, along with new security features, as the big selling points of the new Xeons.
Read More...
Mar 19 | OfficialWire | New super to support intelligence work Down Under. Read more...
Mar 18 | ChannelWeb | Westmere parts already showing up in HPC machines. Read more...
Mar 17 | The Register | But what about the tier ones? Read more...
Mar 17 | Cadalyst Magazine | A new generation of workstations is changing the nature of technical computing. Read more...
Mar 17 | Linux Magazine | Latest iteration of Sun Grid Engine able to tap into Cloud. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html