HPCwire: Microsoft Releases Its Cluster Solution

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

HPCwire >> Features

June 09, 2006

Microsoft Releases Its Cluster Solution

by Michael Feldman, Editor, HPCwire

Page: 1 of 2
1 | 2 All »

In 1993, Donald Becker and Thomas Sterling began designing x86-based computer clusters, intended to be low-cost alternatives to the large supercomputers of the day. The 'Beowulf' systems caught on quickly and spread throughout government and academic research communities. The era of commodity clusters was born.

More than a decade later, Microsoft decided that the HPC market was now ready for a commodity cluster management solution. And today, Microsoft Corporation announced the release to manufacturing of Windows Compute Cluster Server 2003 (CCS), its first offering into the HPC market. The CCS product is designed to manage 64-bit x86 computational clusters for high performance workloads, challenging Linux dominance of this market.

The release to manufacturing represents the company's formal product announcement. It means that the Microsoft development team has signed off on the completion of the CCS product. Although evaluation versions will be available very soon from the Microsoft website for downloading, the product won't be generally available for purchasing until August. Other partnering OEMs will be announcing support over the next few months.

Following the spread of HPC from government and academia into the enterprise, the CCS product is designed to give more users access to the power of high performance computing. With this product, Microsoft is going after the volume cluster market, what IDC classifies as workgroup and departmental cluster systems, although CCS is designed to scale to much larger systems. Kyril Faenov, Microsoft's director for HPC, said that this offering will accelerate the proliferation of commodity clusters into mainstream applications.

"This is a fundamental part of our strategy -- to bring HPC to the broadest number of users possible," said Faenov. "What is particularly exciting about this time is that the last few years have seen tremendous growth in HPC clustering. IDC data for 2005 has shown 23 percent growth in the HPC market, overall, and the cluster portion specifically, growing 70 percent by revenue. So there's an explosion of opportunity happening."

The CCS product has been under development at Microsoft for the last two years. It is built on the foundation of the Windows Server 2003 64-bit platform, which provide mission-critical capabilities for the enterprise. This enables the company to leverage its investment in enterprise server software and lets Microsoft customers avoid requalifying a different server stack.

Faenov observed that, today, many people essentially go out and purchase a rack of servers and with the idea of turning them into functional clusters. In this scenario, the user has to find HPC specialists to essentially piece these clusters together from stand-alone operating system and network components. Usually this entails selection of an open-source cluster-capable OS. Then they have to figure out the parallel programming stacks that will support their applications, make sure that the underlying interconnect support is available and integrate these things with the OS that they're using. An additional complication is figuring out how to maintain security for the cluster resource with the rest of their infrastructure. Integrated cluster solutions, typically Linux-based, using commodity processors and interconnects tend to hide most of this complexity; but in this case the customer is limited to the particular vendor's hardware offerings.

What Microsoft wanted to do was provide an integrated software solution for clusters that was hardware neutral -- at least in the 64-bit x86 sense -- and could be easily integrated into existing enterprise infrastructure. For existing Windows shops, it gives organizations the ability to leverage skill sets, especially Windows network administrations skills. In this environment, CCS should fit in rather easily.

Its integration with Active Directory, which is installed in 80 percent of large enterprises, allows CCS to provide secure cluster access and job scheduling. A cluster system becomes just another Active Directory object, like a network printer. So from a workstation, you can discover clusters, monitor your jobs, submit new jobs and modify them. In this sense, CCS just extends the Active Directory model to recognize a new kind of resource. Faenov said that Microsoft is also working with ISVs to provide cluster access from within vendor applications, just as you would access a printer from any Windows program. This suggests that enterprises that are highly invested in Windows-based systems today will have a pretty clear path to cluster scale out.

"On the other hand, we still think there are advantages for shops that might have deployed Linux or proprietary Unix-based HPC systems -- specifically in providing better integration for their users," said Faenov. "There are really no purely Linux shops or purely Windows shops, for that matter, especially when it comes to HPC. In many cases, what we see in engineering shops is that the people have Windows workstations. When it comes time to use the computational resource, they have to drop to the command line and use SSH or Telnet into the remote cluster, move their data over there, [do the computation,] then move it back. What that does is disconnect the user from an important part of their workflow -- analysis of their models and the results."

Page: 1 of 2
1 | 2 All »

Article Tools

Share Options

(Digg, Technorati, more)

Subscribe

Subscribe to HPCwire

Discussion

There are 0 discussion items posted.

Join the Discussion

You must be a registered user in order to comment on HPCwire stories.

Members enjoy:

	Access to Special Content, including Podcasts, Webcasts, and Whitepapers and more!
	Ability to take an active role in the discussions that are shaping the HPC technology discipline!
	Special offers available only to HPCwire members!

Become a Registered User Today!

Registered Users Log in Here to Comment

Email Address:	Password (case sensitive)

Remember me	Forgot Password?

RSS Feeds

Feeds by Topic

Feeds by Industry

Feeds by Content Type

Top Headlines

Australia Commissions Cray Supercomputer

Mar 19 | OfficialWire | New super to support intelligence work Down Under. Read more...

Intel Partners See 'Easy' Upgrade Path With Xeon 5600 Chips

Mar 18 | ChannelWeb | Westmere parts already showing up in HPC machines. Read more...

AMD: OEMs primed for Opteron 6100s

Mar 17 | The Register | But what about the tier ones? Read more...

Arrival of the Desktop Supercomputer

Mar 17 | Cadalyst Magazine | A new generation of workstations is changing the nature of technical computing. Read more...

Scheduling HPC In The Cloud

Mar 17 | Linux Magazine | Latest iteration of Sun Grid Engine able to tap into Cloud. Read more...

Read more headlines...

Featured Whitepapers

Virtualization for Aggregation And The vSMP Architecture™

Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.

Copper Cable Technologies for High Performance Computing

Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.

View the White Paper Library

Multimedia

Webcast: Virtualized Data Center Roundtable

Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.

Webcast: Watch SC09 Birds of a Feather Video: Scalable Fault-Tolerant HPC Supercomputers

Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.

Webcast: High Performance Computing for a Smarter Planet

LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html