The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
July 01, 2009
GENEVA, July 1 -- Preparations are under way for the restart of the Large Hadron Collider (LHC), the world's most powerful particle accelerator. One of the most important systems needed to support the experiments that will utilise this great machine is the global computing grid: the worldwide LHC Computing Grid (WLCG). After months of preparation and two intensive weeks of 24 x 7 operation, the LHC experiments are celebrating the achievement of a new set of goals aimed at demonstrating full readiness for the LHC data taking run expected to start later this year.
Whilst there have been several large-scale data-processing tests in recent years, this was the first production demonstration involving all of the key elements from data taking through to analysis. Records of all sorts were established: data taking throughput, data import and export rates between the various grid sites, as well as huge numbers of analysis, simulation and reprocessing jobs -- ATLAS alone running close to 1M analysis jobs and achieving 6GB/s, of "grid traffic," the equivalent of a DVD worth of data a second, sustained over long periods.
This result is particularly timely as it coincides with the transition of grids into long-term sustainable e-infrastructures, clearly of fundamental importance to projects of the lifetime of the LHC. With the restart of the LHC only months away, one can expect a large increase in the number of grid users: from several hundred unique users today to several thousand when data taking and analysis commences. This can only happen through significant streamlining of operations and the simplification of end-users' interaction with the grid. Scale Testing for the Experiment Programme '09 (STEP'09) included massive-scale testing of end-user analysis scenarios, including "community-support" infrastructures, whereby the community is trained and enabled to be largely self-supporting, backed by a core of grid and application experts.
WLCG combines the IT power of more than 140 computer centres, the result of collaboration between 33 countries.
Sergio Bertolucci, director of research and computing at CERN, said: "The four LHC experiments -- ATLAS, CMS, ALICE and LHCb -- have demonstrated their ability to manage their nominal data rates concurrently. For the first time all aspects of the experiments' computing were exercised simultaneously: simulation, data processing and analysis. This gives them the confidence that they will be able to efficiently analyze the first data from the LHC later this year."
Bob Jones, director of the EGEE project, remarked: "Such a significant achievement is also a valuable testament to the state of maturity of the EGEE infrastructure and its ability to interoperate with major grid infrastructures in other parts of the world. Ensuring that this level of service continues uninterrupted as we transition from EGEE to EGI is clearly essential to our users, including flagship communities such as high energy physics."
"This is another significant step to demonstrating shared infrastructures can be used by multiple high throughput science communities simultaneously," said Ruth Pordes, executive director of the Open Science Grid consortium. "ATLAS and CMS are not only proving the usability of OSG, but contributing to maturing national distributed facilities in the US for other sciences."
David Britton, the GridPP Project Leader, reported: "In the UK, STEP09 ran very smoothly at the majority of sites, which allowed the focus to be on understanding the performance and tuning the infrastructure. The RAL Tier-1 performed exceedingly well with only a single out-of-hours call out over the two week period. Valuable information was obtained on the performance of tape-drives under realistic workflows; the OPN network was tested by laying down additional UDP traffic on top of the STEP09 data; and the fairshare system was successfully tuned to balance the load between experiments."
Gonzalo Merino, manager of the Tier1 centre in Barcelona, wrote: "The Spanish WLCG sites met the STEP09 targets. It has been a very valuable exercise since many of the experiment workflows have been tested simultaneously at unprecedented scale, well above the nominal values for LHC data taking. The Tier-1 at PIC has provided a very stable and reliable service at record breaking levels: exchanging up to 80 terabytes per day with other WLCG sites and processing data at more than 2 GBytes per second. This gives us confidence that the Spanish WLCG sites are ready for data taking."
David Foster, head of the LHC Optical Private Network activity, concluded: "The LHC Optical Private Network transporting data between the sites has proven its capability both in terms of performance and resiliency during STEP'09. New capabilities emerging in the 40Gbps and 100Gbps range should enable us to keep up with the anticipated data distribution needs of the LHC experiments."
Page: 1 of 2(Digg, Technorati, more)
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
The prospects for virtual SMP technology got another boost last month when Florida State University announced it had installed a new HPC system from 3Leaf Systems. The servers are being housed at the university's HPC facility and will be used across a range of scientific disciplines.
Read More...
For the first time in 62 years, the four-man Olympics bobsled team from the US captured the gold medal, setting a course world record in the process. The winning bobsled had some state-of-the-art engineering behind it, including CFD software from Exa Corporation. As it turned out, that software may have proved to be the margin of difference in the race.
Read More...
Cray and Microsoft Research partner on cloud computing project; IBM donates a POWER7-based supercomputer to Rice University; and the Kavli Foundation hosts a dialogue on the convergence of nanoscience and neuroscience. We recap those stories and more in our weekly wrapup.
Read More...
Mar 09 | Free Software Magazine | Data-driven computing will need open software. Read more...
Mar 09 | Bio-IT World | Tahoe Informatics founder eyes GPUs, CUDA software. Read more...
Mar 08 | Sporting Life | Formula One engineers differ on benefits of CFD. Read more...
Mar 08 | InfoWorld | AMD offers up 48-core server prize. Read more...
Mar 04 | Linux Magazine | The new x86 multicore offerings could portend big changes for HPC platforms. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html