The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
March 28, 2008
In just eleven days during 2007, the Stanford University High-Performance Computing (HPC) Center nearly doubled the performance of its existing compute system. The center leveraged certification methodology from the Intel Cluster Ready Program to fully implement a 1,696-core cluster solution. The solution integrates Clustercorp, Dell and Panasas technologies to give the center the flexibility to meet ever-expanding computational and application requirements and to enable Stanford researchers to achieve faster time-to-results. Steve Jones, the founder and manager of the Stanford HPC Center, writes about the design and deployment of this system.
Mission: Enable CFD on Demand
The goal of our expansion was simple: acquire sufficient compute power to facilitate School of Engineering coursework and research efforts and to support the university's industrial affiliates program.
The system would need to support more than 200 researchers and effectively enable CFD on demand. Two departments in particular require large-scale, massively parallel computing resources for their work. Researchers in the mechanical engineering and aeronautics and astronautics departments leverage HPC Center resources to analyze the details of flow and acoustics created by helicopters in forward flight. Critical applications include two major in-house-developed simulation codes: Stanford University multiblock (SUmb) and CDP, named for the late Charles David Pierce. Commercial applications include ANSYS, Gaussian, MatLab, and VASP. Stanford's post-processing programs include EnSight for distributed rendering and Tecplot for visualization.
Objective: Extend In-House Support for Complex Code Verification and Validation
To address Stanford researchers' increasing needs for code validation, our team opted to bolster local compute resources. The goal was to build a cluster-based solution capable of scaling to thousands of nodes and supporting our large user base. The minimum expectation for the cluster was to run routine jobs in-house and to allow researchers to do more extensive verification and validation of code destined for the national labs. In addition to the large compute capacity and scalability requirements, the system needed to be capable of sustained performance with a file system fast enough to cope with massive I/O load and to deliver the granularity of results researchers require.
Challenge: Overcome Limitations in Space, Time, and Staff
While our plan was to dramatically expand compute resources, the project was bound by constraints of space, time and staff. The Stanford HPC Center has limited square footage in which to operate, so footprint was an issue, not only in terms of the system size and density, but also in how it would impact general HVAC requirements. Extensive project demands also applied scheduling pressures that propelled the deployment team to implement a more aggressive rollout than the three- to six-month timeframe more typically allotted for implementations of this scope. The final challenge was the center's requirements to grow overall services delivery while maintaining the existing support staff.
We felt that taking advantage of an integrated solution would help us meet our compute and deployment objectives without exceeding our space, time, and staffing limitations. In particular, we were sold on the idea of the Intel Cluster Ready (ICR) program where certification of the Clustercorp/Dell/Panasas solution had been completed upfront. The certification provides cluster components validation to ensure accurate configuration, optimal performance, and a system that is easy to manage and seamlessly expand.
Solution: Use Certified Best-of-Breed Compute, Distribution, and Storage Components
Page: 1 of 3(Digg, Technorati, more)
Jul 06 | TechRadar | Breaking the exaflops barrier will help keep the nation's nuclear weapons safe. And that's just the start. Read more...
Jul 01 | GenomeWeb Daily News | The popularity of cloud computing in the life sciences community was on full display at April's Bio-IT World conference. Read more...
Jul 01 | Linux Magazine | How can getting to the ocean help with HPC computing? Read more...
Jun 29 | GCN.com | Agency issues RFI for "Ubiquitous High Performance Computing" systems. Read more...
Jun 29 | Computerworld | The bottom of the TOP500 reveals the coming revolution in truly accessible high-end computing. Read more...
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.