The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
August 04, 2008
Hybrid solution makes cluster OS choice a thing of the past
PROVO, Utah, Aug. 4 -- Miniature computers are everywhere -- on silicon chips in our cell phones, watches, kitchen appliances, and even our automobiles. Going through a normal day without benefiting in some way from one or more of these tiny computers is practically impossible.
But the real workhorses of the computer world don't reside on those tiny, hidden microchips. They're "supercomputers" -- systems that may include thousands of computer processors working together to answer life's biggest questions. These supercomputers answer questions that lead to new life-saving medicines, more efficient oil and gas production, and safer automobiles and workplace environments.
Such a supercomputer, known as Firefly, has its home at the Holland Computing Center, one of the largest supercomputing facilities in the United States. Firefly is a 1,154-node cluster of Dell SC1435 servers and is capable of a sustainable computational rate of 21.5 teraflops (trillion calculations per second).
While speed is a key objective in supercomputing, for the Holland Computing Center speed is secondary to the goal of Firefly. Firefly is used to focus on "what-if" computations: asking -- and answering -- questions that have never even been conceived of before.
In developing the system, Jim Skirvin, president of the Holland Computing Center, selected Rocks+Moab, a joint solution from Cluster Resources and Clustercorp that combines a complete, tightly integrated HPC software stack on a single DVD (Rocks+) with enterprise-class resource- and workload-management tools (Moab Cluster Suite).
"When it comes to selecting vendors, we look for partners we know we can work with over the long term, partners who will help us achieve our center's goals," said Skirvin. "Based on that principle, selecting the Clustercorp / Cluster Resources team was a no-brainer. They offered a smart and holistic toolset that would get the job done, and right from the get-go their approach was 'What can we do to make this partnership work better?' "
To cater to the needs of users running Windows applications, the center made an early design decision to run both Linux and Windows (CCS) operating systems. In an industry dominated by Linux-based clusters and users, this choice created a set of difficult decisions that required the cluster administrator to set up the cluster to run either Windows or Linux based on user needs and then allocate the cluster's resources appropriately. As part of this time-consuming process, Firefly was divided into two or three non-contiguous clusters at any given time.
The implementation of the Rocks+Moab solution at the Holland Computing Center made platform choice a thing of the past -- Firefly now operates as the first-of-its-kind 1,000+ node hybrid compute resource where both Windows and Linux applications can run concurrently on the same cluster. In the hybrid paradigm the cluster is now a single unified compute resource, with Moab able to dynamically change the OS of any compute node based on workflow. This process is made nearly invisible to the user through a simple setup built into Rocks+ and unified job submission in Moab.
"A unique capability of Rocks+Moab, and one that was very intriguing to us, is its ability to have a static implementation of two operating systems that we could dynamically switch between," noted Skirvin. "We had a work-around solution that was painful at best and very time consuming. By switching to Rocks+Moab we were able to utilize either operating system, which created a huge time savings for our admin."
Page: 1 of 2(Digg, Technorati, more)
White Paper: HPC in a Green and Modular Solution Building Block
Learn how the Appro GreenBlade™ System helps consolidate server, storage, network, power and simplified management capabilities in a single package while providing the performance-density, energy-efficiency and best ROI for your business.
Petascale Computing: Algorithms and Applications, edited by David A. Bader, is the first book in CRC's Computational Science Series, edited by Horst Simon. Although the book is a collection of papers, Bader has done an excellent job of creating a compilation that holds together and covers a broad topic very well.
Read More...
Cilk++ used in parallelization of the FP-tree algorithm for pattern mining; Istanbul benchmark results posted; and the latest on the NVIDIA Tesla shortage. John West recaps those stories and more in our weekly wrap-up.
Read More...
Last week's International Supercomputing Conference (ISC'09) was a convenient excuse for vendors to announce a raft of new products, but three, in particular, stood out.
Read More...
Jul 01 | GenomeWeb Daily News | The popularity of cloud computing in the life sciences community was on full display at April's Bio-IT World conference. Read more...
Jul 01 | Linux Magazine | How can getting to the ocean help with HPC computing? Read more...
Jun 29 | GCN.com | Agency issues RFI for "Ubiquitous High Performance Computing" systems. Read more...
Jun 29 | Computerworld | The bottom of the TOP500 reveals the coming revolution in truly accessible high-end computing. Read more...
Jun 18 | EE Times | Parallel software also takes spotlight at Stanford confab. Read more...
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.