March 24, 2010
March 22 -- The National Center for Supercomputing Applications (NCSA) has selected Linux as the operating system for the multi-petaflop IBM POWER7-based Blue Waters supercomputer that will come online in 2011.
Staff at NCSA and IBM evaluated both the open-source Linux and IBM's AIX as potential operating systems for Blue Waters, extensively testing both on identical hardware at large scale. SARA Computing and Networking Services in the Netherlands and the U.S. National Center for Atmospheric Research (NCAR) shared their experiences and provided access to their large IBM POWER6 systems, both with more than 3,300 cores and both using Infiniband interconnects. Both ran IBM's full HPC Software stack and used the GPFS file system. SARA's system uses Linux, while NCAR uses AIX.
More than 160 features and functions were reviewed, including features for reliability, use of unique hardware features, performance monitoring, accounting, file systems, resource management, memory management, security, programming environments and OS resource use. Because Blue Waters will not enter full service until 2011, and will continue to operate for at least five years, the evaluation took into account the road map of future features for each operating system.
"We looked at the features that will be part of each OS in 2011, not just the features available today," said Blue Waters deputy project director William Kramer.
NCSA also conducted multiple application performance tests, including MILC, PARATEC, four of the NAS Parallel Benchmarks (Fast Fourier Transform, Conjugate Gradient, Lower-Upper symmetric Gauss-Seidel, and MultiGrid) for Class B and Class D problem sizes, HPC Challenge Benchmarks, and parallel 3D Fast Fourier Transform tests.
The team also used an AIX POWER6/InfiniBand system at the European Center for Medium-Range Weather Forecasting (ECMWF) to study jitter, the amount of application interference caused by OS functions, which can limit an application's ability to run efficiently at large scale.
"We determined that either OS could ably meet the requirements for Blue Waters and serve the science and engineering research community," Kramer said. "Linux offered some additional advantages, such as being somewhat more familiar to the research community and offering the potential for NCSA to more directly participate in enhancing the OS."
The collaborators plan to publish the OS performance results for both Linux and AIX.
Blue Waters is based on the most advanced technologies under development at IBM, which are embodied in the PERCS (Productive, Easy-to-use, Reliable Computing System) system design. The development of PERCS is supported by the Defense Advanced Research Projects Agency (DARPA) High Productivity Computing Systems (HPCS) program.
Under HPCS, IBM has produced capabilities for both AIX and Linux HPC deployments. DARPA and IBM have also selected Linux for the IBM PERCS prototype.
-----
Source: NCSA
In quieter times, sounding the bell of funding big science with big systems tends to resonate further than when ears are already burning with sour economic and national security news. For exascale's future, however, the time could be ripe to instill some sense of urgency....
Read more...
In a recent solicitation, the NSF laid out needs for furthering its scientific and engineering infrastructure with new tools to go beyond top performance, Having already delivered systems like Stampede and Blue Waters, they're turning an eye to solving data-intensive challenges. We spoke with the agency's Irene Qualters and Barry Schneider about..
Read more...
Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...
May 23, 2013 |
The study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
Read more...
May 22, 2013 |
At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
Read more...
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
Read more...
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.