Visit additional Tabor Communication Publications
November 14, 2011
Demo leverages ESnet’s transcontinental Advanced Networking Research Initiative (ANI) testbed and multi-vendor participation to demonstrate RDMA-enabled data transfer, spanning approximately 7,000 miles
SEATTLE, Wash., Nov. 14 -- Today at Supercomputing 2011 (SC11), the international conference for high performance computing, networking, storage and analysis, researchers from Orange Silicon Valley, The Department of Energy’s Energy Sciences Network (ESnet), InfiniBand Trade Association (IBTA) and OpenFabrics Alliance (OFA) join forces with the SC11 conference network SCinet to showcase the world’s first demonstration of a Remote Direct Memory Access (RDMA)-enabled data transfer at 40 Gigabits per second (Gbps) over wide area network links spanning approximately 7,000 miles.
This experiment marks the first time that RDMA has been demonstrated at 40Gbps data rates for such a long distance, showcasing the technology’s ability to improve performance for bulk data transfer in the wide area. The demonstration illustrates three usage models of RDMA at such a distance: the ability to move multiple simultaneous data streams; the ability for a user to access a remote data set as though it were locally mounted; and the ability to move large file transfers at high bandwidths. The RDMA protocols in the wide area enable the three usage models to achieve up to 96 percent utilization of the available bandwidth in the network.
During the demonstration, SC11 attendees will see firsthand how RDMA enables servers in the local nodes to transfer data to or from application memory, eliminating the overhead of copying data between application memory and the data buffers in the operating system. When an application performs an RDMA operation, the application data is delivered directly to the network, eliminating the additional latency the transfer would incur if the data were to be copied into the operating system memory buffers. This dramatically increases the application-messaging rate and the application processing efficiency of the servers from approximately 20 percent up to 80-90 percent.
“RDMA communication opens new possibilities for collaboration among researchers by enabling quick and efficient data sharing,” said Jim Ryan, chair of the Open Fabrics Alliance. “By eliminating many of the typical network performance bottlenecks, users make more efficient use of their WAN, cloud and data center infrastructures.”
The demonstration was conceived this past summer when Orange Silicon Valley, a subsidiary of France Telecom-Orange, an international operator for mobile and broadband Internet services and one of the world leaders in providing telecommunication services to multinational companies, partnered with ESnet and Bay Microsystems to perform the first field trial of this technology demonstrating RDMA protocols over a 40Gbps WAN over a distance of 230 miles. The success of that field trial encouraged Orange Silicon Valley and the collaborators to consider longer distance trials at SC11, leveraging the SC11 SCinet Research Sandbox (SRS), a conference program, which provides a venue for network researchers to showcase disruptive innovation in an experimental network environment.
Orange Silicon Valley successfully submitted a proposal to the SCinet SRS to showcase this technology at SC11, choosing the OFA and IBTA booth based on both consortiums’ vision of embracing open standards. The SC11 demonstration – including technology from members of both the IBTA and OFA - leverages ESnet’s nationwide ANI Testbed which is being made available to researchers both in the public and private sector as a first of its kind platform to test experimental approaches to new network protocols and architectures in a greater than 10 Gbps network environment.
“This collaboration at SC11 between Orange Silicon Valley, ESnet and members of the IBTA and OFA enables a unique environment for demonstrating the benefits of globally scaling out and deploying RDMA-enabled applications,” said Brian Sparks, co-chair of the marketing working groups of the IBTA and OFA.
The following member companies provided hardware, software, architectural and/or operational expertise in this demonstration: 3M, Bay Microsystems, Chelsio Communications, DataDirect Networks, Finisar, HP, Mellanox Technologies, NetApp, Software Forge, System Fabric Works and Volex.
About the InfiniBand Trade Association
The InfiniBand Trade Association was founded in 1999 and is chartered with maintaining and furthering the InfiniBand specification. The IBTA is led by a distinguished steering committee that includes HP, IBM, Intel, Mellanox Technologies, Oracle, QLogic Corporation and System Fabric Works. Other members of the IBTA represent leading enterprise IT vendors who are actively contributing to the advancement of the InfiniBand specification. The IBTA markets and promotes InfiniBand from an industry perspective through online, marketing and public relations engagements, and unites the industry through IBTA-sponsored technical events and resources. For more information on the IBTA, visit http://www.infinibandta.org.
About the OpenFabrics Alliance
The OpenFabrics Alliance (OFA) is a 501c) (6) non-profit association that develops, tests, licenses and distributes the OpenFabrics Enterprise Distribution (OFED) – multi-platform, open-source software for high-performance, low-latency and energy-efficient computing. OFED is used in business, research and scientific environments that require fast and efficient networks, storage connectivity and parallel computing. OFED is free and is included in major Linux distributions, as well as Microsoft Windows. In addition to distributing OFED, the OFA conducts training, workshops and interoperability testing to ensure all releases meet multivendor enterprise requirements for security, usability and reliability. For more information about the OFA, visit http://www.openfabrics.org.
France Telecom-Orange is one of the world’s leading telecommunications operators with 170,000 employees worldwide, including 102,000 employees in France, and sales of 33.8 billion euros in the first nine months of 2011. Present in 35 countries, the Group had a customer base of 221 million customers at 30 September 2011, including 145 million customers under the Orange brand, the Group's single brand for Internet, television and mobile services in the majority of countries where the company operates. On 30 September 2011, the Group had 162 million mobile customers and 14 million broadband internet (ADSL, fibre) customers worldwide. Orange is one of the main European operators for mobile and broadband Internet services and, under the brand Orange Business Services, is one of the world leaders in providing telecommunication services to multinational companies.
With its industrial project, "conquests 2015,” Orange is simultaneously addressing its employees, customers and shareholders, as well as the society in which the company operates, through a concrete set of action plans. These commitments are expressed through a new vision of human resources for employees; through the deployment of a network infrastructure upon which the Group will build its future growth; through the Group's ambition to offer a superior customer experience thanks in particular to improved quality of service; and through the acceleration of international development. For more information, visit http://www.orange.com.
ESnet provides the high-bandwidth, reliable connections that link scientists at national laboratories, universities and other research institutions, enabling them to work together on some of the world's most important scientific challenges including energy, climate science, and the origins of the universe. Funded by the U.S. Department of Energy's Office of Science, and managed and operated by the ESnet team at Lawrence Berkeley National Laboratory (Berkeley Lab), ESnet provides scientists with access to unique DOE research facilities and computing resources, as well as to scientific collaborators including research and education networks around the world.
Source: Orange Silicon Valley, ESnet, InfiniBand Trade Association, and OpenFabrics Alliance
In a recent solicitation, the NSF laid out needs for furthering its scientific and engineering infrastructure with new tools to go beyond top performance, Having already delivered systems like Stampede and Blue Waters, they're turning an eye to solving data-intensive challenges. We spoke with the agency's Irene Qualters and Barry Schneider about..
Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
The Xeon Phi coprocessor might be the new kid on the high performance block, but out of all first-rate kickers of the Intel tires, the Texas Advanced Computing Center (TACC) got the first real jab with its new top ten Stampede system.We talk with the center's Karl Schultz about the challenges of programming for Phi--but more specifically, the optimization...
May 22, 2013 |
At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
May 10, 2013 |
Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.