Nvidia
Cray
HPCwire

Since 1986 - Covering the Fastest Computers
in the World and the People Who Run Them

Language Flags

Visit additional Tabor Communication Publications

Datanami
Digital Manufacturing Report
HPC in the Cloud
Green Computing Report

Tabor Communications
Corporate Video

Long Distance 40Gbps RDMA Data Transfers Demonstrated at SC11


Demo leverages ESnet’s transcontinental Advanced Networking Research Initiative (ANI) testbed and multi-vendor participation to demonstrate RDMA-enabled data transfer, spanning approximately 7,000 miles

SEATTLE, Wash., Nov. 14 -- Today at Supercomputing 2011 (SC11), the international conference for high performance computing, networking, storage and analysis, researchers from Orange Silicon Valley, The Department of Energy’s Energy Sciences Network (ESnet), InfiniBand Trade Association (IBTA) and OpenFabrics Alliance (OFA) join forces with the SC11 conference network SCinet to showcase the world’s first demonstration of a Remote Direct Memory Access (RDMA)-enabled data transfer at 40 Gigabits per second (Gbps) over wide area network links spanning approximately 7,000 miles.

This experiment marks the first time that RDMA has been demonstrated at 40Gbps data rates for such a long distance, showcasing the technology’s ability to improve performance for bulk data transfer in the wide area. The demonstration illustrates three usage models of RDMA at such a distance: the ability to move multiple simultaneous data streams; the ability for a user to access a remote data set as though it were locally mounted; and the ability to move large file transfers at high bandwidths. The RDMA protocols in the wide area enable the three usage models to achieve up to 96 percent utilization of the available bandwidth in the network.

During the demonstration, SC11 attendees will see firsthand how RDMA enables servers in the local nodes to transfer data to or from application memory, eliminating the overhead of copying data between application memory and the data buffers in the operating system. When an application performs an RDMA operation, the application data is delivered directly to the network, eliminating the additional latency the transfer would incur if the data were to be copied into the operating system memory buffers. This dramatically increases the application-messaging rate and the application processing efficiency of the servers from approximately 20 percent up to 80-90 percent.

“RDMA communication opens new possibilities for collaboration among researchers by enabling quick and efficient data sharing,” said Jim Ryan, chair of the Open Fabrics Alliance. “By eliminating many of the typical network performance bottlenecks, users make more efficient use of their WAN, cloud and data center infrastructures.”

The demonstration was conceived this past summer when Orange Silicon Valley, a subsidiary of France Telecom-Orange, an international operator for mobile and broadband Internet services and one of the world leaders in providing telecommunication services to multinational companies, partnered with ESnet and Bay Microsystems to perform the first field trial of this technology demonstrating RDMA protocols over a 40Gbps WAN over a distance of 230 miles. The success of that field trial encouraged Orange Silicon Valley and the collaborators to consider longer distance trials at SC11, leveraging the SC11 SCinet Research Sandbox (SRS), a conference program, which provides a venue for network researchers to showcase disruptive innovation in an experimental network environment.

Orange Silicon Valley successfully submitted a proposal to the SCinet SRS to showcase this technology at SC11, choosing the OFA and IBTA booth based on both consortiums’ vision of embracing open standards. The SC11 demonstration – including technology from members of both the IBTA and OFA - leverages ESnet’s nationwide ANI Testbed which is being made available to researchers both in the public and private sector as a first of its kind platform to test experimental approaches to new network protocols and architectures in a greater than 10 Gbps network environment.

“This collaboration at SC11 between Orange Silicon Valley, ESnet and members of the IBTA and OFA enables a unique environment for demonstrating the benefits of globally scaling out and deploying RDMA-enabled applications,” said Brian Sparks, co-chair of the marketing working groups of the IBTA and OFA.

The following member companies provided hardware, software, architectural and/or operational expertise in this demonstration: 3M, Bay Microsystems, Chelsio Communications, DataDirect Networks, Finisar, HP, Mellanox Technologies, NetApp, Software Forge, System Fabric Works and Volex.

About the InfiniBand Trade Association

The InfiniBand Trade Association was founded in 1999 and is chartered with maintaining and furthering the InfiniBand specification. The IBTA is led by a distinguished steering committee that includes HP, IBM, Intel, Mellanox Technologies, Oracle, QLogic Corporation and System Fabric Works. Other members of the IBTA represent leading enterprise IT vendors who are actively contributing to the advancement of the InfiniBand specification. The IBTA markets and promotes InfiniBand from an industry perspective through online, marketing and public relations engagements, and unites the industry through IBTA-sponsored technical events and resources. For more information on the IBTA, visit http://www.infinibandta.org.

About the OpenFabrics Alliance

The OpenFabrics Alliance (OFA) is a 501c) (6) non-profit association that develops, tests, licenses and distributes the OpenFabrics Enterprise Distribution (OFED) – multi-platform, open-source software for high-performance, low-latency and energy-efficient computing. OFED is used in business, research and scientific environments that require fast and efficient networks, storage connectivity and parallel computing. OFED is free and is included in major Linux distributions, as well as Microsoft Windows. In addition to distributing OFED, the OFA conducts training, workshops and interoperability testing to ensure all releases meet multivendor enterprise requirements for security, usability and reliability. For more information about the OFA, visit http://www.openfabrics.org.

About Orange

France Telecom-Orange is one of the world’s leading telecommunications operators with 170,000 employees worldwide, including 102,000 employees in France, and sales of 33.8 billion euros in the first nine months of 2011. Present in 35 countries, the Group had a customer base of 221 million customers at 30 September 2011, including 145 million customers under the Orange brand, the Group's single brand for Internet, television and mobile services in the majority of countries where the company operates. On 30 September 2011, the Group had 162 million mobile customers and 14 million broadband internet (ADSL, fibre) customers worldwide. Orange is one of the main European operators for mobile and broadband Internet services and, under the brand Orange Business Services, is one of the world leaders in providing telecommunication services to multinational companies.

With its industrial project, "conquests 2015,” Orange is simultaneously addressing its employees, customers and shareholders, as well as the society in which the company operates, through a concrete set of action plans. These commitments are expressed through a new vision of human resources for employees; through the deployment of a network infrastructure upon which the Group will build its future growth; through the Group's ambition to offer a superior customer experience thanks in particular to improved quality of service; and through the acceleration of international development. For more information, visit http://www.orange.com.

About ESnet

ESnet provides the high-bandwidth, reliable connections that link scientists at national laboratories, universities and other research institutions, enabling them to work together on some of the world's most important scientific challenges including energy, climate science, and the origins of the universe. Funded by the U.S. Department of Energy's Office of Science, and managed and operated by the ESnet team at Lawrence Berkeley National Laboratory (Berkeley Lab), ESnet provides scientists with access to unique DOE research facilities and computing resources, as well as to scientific collaborators including research and education networks around the world.

-----

Source: Orange Silicon Valley, ESnet, InfiniBand Trade Association, and OpenFabrics Alliance

Sponsored Links

Accelerate your science with Seneca
One of the first HPC providers installing a 4X NVIDIA Kepler K-20 cluster. Invites you to a free evaluation on Seneca’s NVIDIA K20 Kepler cluster, pre-loaded with AMBER, NAMD, LAMMPS

Webinar: Programming Heterogeneous X64+GPU Systems Using OpenACC
Join Michael Wolfe as he compares the advantages and costs of using both low-level models and the directive-based OpenACC model for programming accelerated heterogeneous systems. Registration is free.

High-Performance Computing in Action
Businesses that want to be on the cutting edge of their industries are increasingly turning to high-performance computing (HPC) solutions to handle complex compute processes and speed up their rate of innovation. Download this Executive Brief to see how businesses in energy, life sciences and entertainment put HPC solutions to work in their operations.

May 22, 2013

May 21, 2013

May 20, 2013

May 17, 2013

May 16, 2013

May 15, 2013

May 14, 2013

May 13, 2013

May 10, 2013


Most Read Features

Most Read Around the Web

Most Read This Just In


Feature Articles

NSF Forges Further Beyond FLOPs

In a recent solicitation, the NSF laid out needs for furthering its scientific and engineering infrastructure with new tools to go beyond top performance, Having already delivered systems like Stampede and Blue Waters, they're turning an eye to solving data-intensive challenges. We spoke with the agency's Irene Qualters and Barry Schneider about..
Read more...

CERN, Google Drive Future of Global Science Initiatives

Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...

Saddling Phi for TACC’s Stampede

The Xeon Phi coprocessor might be the new kid on the high performance block, but out of all first-rate kickers of the Intel tires, the Texas Advanced Computing Center (TACC) got the first real jab with its new top ten Stampede system.We talk with the center's Karl Schultz about the challenges of programming for Phi--but more specifically, the optimization...
Read more...

Short Takes

Building Supercomputers with Raspberries

May 22, 2013 | At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
Read more...

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

Computing the Physics of Bubbles

May 15, 2013 | Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
Read more...

Internet2 Awards Program Seeks Innovative Applications

May 10, 2013 | Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Progress in Parallel: the Bull Parallel Programming Center

04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.

Sponsored Multimedia

SGI DMF ZeroWatt Disk Solution

In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.

Cray CS300-AC Cluster Supercomputer Air Cooling Technology Video

The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.

SC12 Editorial Feature HPCwire Soundbite sponsored by ISC

HPC Job Bank


Featured Events


  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States





HPCwire Events