The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
September 28, 2007
The first national ring of ESnet4 went live over the summer, marking a key accomplishment for a long-term plan to build the next-generation science network for researchers working in DOE's national labs, universities and industry. The network ring, the first of several to be built, runs across the country with northern and southern routes before meeting up at various locations along the east and west coast. ESnet4 will enable researchers to send and obtain raw data and research results at a significantly faster rate and with greater reliability. The infrastructure underlying ESnet4 is a joint project between ESnet and Internet2.
"The ESnet staff has once again demonstrated that they have the knowledge, experience and dedication to accomplish major paradigm shifts in the service that ESnet provides to DOE's Office of Science community," said William Johnston, head of ESnet at the Lawrence Berkeley National Laboratory.
The partnership between ESnet and Internet2 brings together the expertise of two organizations that provide network services to the majority of scientists in the country. More than 50,000 DOE scientists and 18,000 researchers from universities, other government agencies and private businesses rely on ESnet. Internet2 serves 5 million users at 270 research and educational institutions.
ESnet and Internet2 first announced their partnership to build and deploy the ESnet4 optical circuit-based infrastructure in August last year. After signing an initial agreement to work on the project, the two organizations inked a multi-year extension of that agreement in July this year.
"This continued investment in ESnet by the Department of Energy's Office of Science represents a significant contribution to the nation's research and education infrastructure. In fact, as the single largest supporter of basic research in the physical sciences in the United States, the Office of Science provides research funding for thousands of scientists at universities," Johnston said.
The agreement between ESnet and Internet2 stems from the conclusion that by sharing a common optical circuit infrastructure that is larger than either community could obtain individually, both DOE's and the U.S. research and education community's research would have access to a network infrastructure bigger than either community could build on their own. Another factor supporting the partnership is the fact that nearly 90 percent of the network traffic on ESnet flows to and from the research and education community.
ESnet4 consists of three main elements: the IP network for transferring data at gigabytes or less; the circuit-oriented Science Data Network for moving terabytes of data; and the metropolitan area networks for connecting research centers in the same region to each other and to the IP network and Science Data Network. The Science Data Network will provide ondemand, virtual circuits that will ensure the timely delivery of massive research materials. The project to develop the virtual circuit services is an international collaboration involving ESnet, Internet2, HOPI, NSF's Dragon research network, DOE's Ultra Science Net, CANARIE in Canada, DANTE/GEANT and several of the NRENs in Europe, as well as others.
The deployment of the first national network ring is timely for scientists in disciplines such as high-energy physics. The Fermi Accelerator National Laboratory near Chicago and Brookhaven National Laboratory on Long Island in New York will be the data archive centers in the United States to store, process and distribute data from the Large Hadron Collider (LHC) at CERN near Geneva. LHC, which is scheduled to begin operation next May, will generate roughly 15 petabytes of data annually.
The 10 Gbps national ring represents the first phase of the overall ESnet4 project. Anticipating a significant growth in network traffic in years to come, ESnet and Internet2 set out to build the new network that will meet the researchers' needs. Plans are in place to boost the network's capacity over the next five years, when it will reach more than 200 Gbps.
Through the use of increasingly sophisticated scientific instruments, more powerful supercomputers running more sophisticated models, and parallel file mover systems, scientists are generating a steadily increasing amount of data that must be shared by widely distributed collaborations.
Page: 1 of 2(Digg, Technorati, more)
New Paper: Parallel Computing Without Parallel Programming
Learn how domain experts can run VHLL programs like MATLAB® on a variety of high-performance platforms without low-level reprogramming and how to work with the largest datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Spider, the world's biggest Lustre-based, centerwide file system, has been fully tested to support Oak Ridge National Laboratory's new petascale Cray XT4/XT5 Jaguar supercomputer and is now offering early access to scientists.
Read More...
Wolfram Alpha, the Web-based computational engine introduced in May, is not a traditional supercomputing application, but relies on supercomputers to satisfy its unique requirements.
Read More...
There was a new energy at this year's TeraGrid '09 conference thanks to an outstanding turnout for the student program. Thanks to support from the National Science Foundation, more than 100 high school, undergraduate and graduate students were able to participate in the conference.
Read More...
Jul 09 | Engineer Live | The demand for computational tools to underpin the 3D seismic interpretation process has never been more apparent. Read more...
Jul 08 | EE Times | Unemployment for U.S. engineers has reached record levels, according to government figures. Read more...
Jul 08 | Network World | Global spending for 2009 projected to drop 6 percent, for a total of $3.2 trillion. Read more...
Jul 08 | Linux Magazine | Portability or efficiency? Neither is guaranteed when writing explicit parallel code. Read more...
Jul 07 | Ars Technica | Japanese company builds custom ASIC to accelerate real-time ray traced rendering for the auto industry. Read more...
Jul 10 | | Engineers, scientists, and other domain experts depend on the productivity enabled by very high-level language (VHLL) tools like MATLAB® and Python. However, as datasets grow larger and programs get more sophisticated, ordinary desktop computers can no longer keep up. The paper explores how to run VHLL programs on high-performance platforms without low-level reprogramming. Work with large datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.