December 08, 2006
A team led by researchers and technologists from Indiana University (IU) was recognized for its accomplishments in the 2006 Bandwidth Challenge held recently at the 2006 Supercomputing conference (SC06) in Tampa, Florida.
Competing against the nation's most elite supercomputing centers, the IU-led team, in partnership with the Pittsburgh Supercomputing Center and Oak Ridge National Laboratory, was one of two efforts recognized with an honorable mention. The IU team, directed by Stephen Simms, included researchers from University Information Technology Services (UITS), the IU School of Informatics, and Pervasive Technology Labs.
The theme of this year's Bandwidth Challenge, "Bridging the Hero Gap," encouraged teams to show how their technology innovations allow researchers and scientists to manage and move large amounts of data without relying on "networking heroes" to help at every step. Participating teams were asked to fully use one 10 Gigabit (Gbit) path "end-to-end, disk-to-disk" from the competition venue in Tampa, Florida, back to each team's home institution using their actual production network. IU's effort titled "All in a Day's Work," emphasized how IU's advanced information technology infrastructure allows IU scientists and researchers to make use of leading edge data management and network services each and every day.
The IU team had an impressive finish, peaking at 9.2 Gbit/second, with an approximate sustained average of 5.5 Gbit/second. IU's project featured four IU research teams running real scientific analyses on IU's Data Capacitor -- a 535 TB Lustre file system serving as an intermediate buffer to store and manipulate large data sets -- and a remote Data Capacitor constructed at the competition venue.
IU's Data Capacitor was conceived by IU Professor of Computer Science Randall Bramley, and is funded in part by a grant from the National Science Foundation led by Craig Stewart, chief operating officer of Pervasive Technology Labs. The Data Capacitor creates fundamental new capabilities for IU's advanced cyberinfrastructure and facilitates the participating scientific research projects.
"IU's Data Capacitor can be mounted on multiple distributed resources, allowing it to play a role in every step of the data life cycle, from acquisition or creation, through computation and visualization, to archive stored data," said Simms. "Its ease of use allows scientists to focus on their research – so they can be the heroes in their own field, whether trying to predict a hurricane, or working to cure a disease."
"The IU Data and Search Institute is developing new tools to support data-centric science, and combined with the hardware and expert system staff support, we're able to demonstrate new breakthrough capabilities that will lead to many practical benefits, such as improved ability to predict the paths of tornadoes," said IU team member Beth Plale, associate professor of computer science and director of the Data and Search Institute.
Equipment was provided by Data Direct Networks, Advanced Clustering Technologies, and Force-10 Networks, and featured the Lustre filesystem supported by Cluster File Systems. Myricom's loan of new Myrinet-10G cards was critical to the project's success.
Teams involved in the "All in a Day's Work" project included Beth Plale, Suresh Marru, Chathura Herath, and AJ Ragusa on streaming CASA radar data for tornado prediction; Scott Teige and Stephen Simms on analysis of subatomic particles; Mookie Baik on analysis of disease-forming protein mutations; and Rick McMullen and John Huffman on capture of crystallographic data from multiple distributed sources.
The overall winner of the Bandwidth Challenge was the National Center for Data Mining at the University of Illinois at Chicago, along with partners Northwestern University and Johns Hopkins University. An honorable mention went to a team from the California Institute of Technology, CERN, the University of Florida, and the University of Michigan.
-----
Source: Indiana University
Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...
The Xeon Phi coprocessor might be the new kid on the high performance block, but out of all first-rate kickers of the Intel tires, the Texas Advanced Computing Center (TACC) got the first real jab with its new top ten Stampede system.We talk with the center's Karl Schultz about the challenges of programming for Phi--but more specifically, the optimization...
Read more...
Although Horst Simon was named Deputy Director of Lawrence Berkeley National Laboratory, he maintains his strong ties to the scientific computing community as an editor of the TOP500 list and as an invited speaker at conferences.
Read more...
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
Read more...
May 10, 2013 |
Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...
May 09, 2013 |
The Japanese government has revealed its plans to best its previous K Computer efforts with what they hope will be the first exascale system...
Read more...
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.