Ethernet Innovations Take Aim at HPC

By Nicole Hemsoth

November 15, 2011

Formed in 2006, the Ethernet Alliance is the non-profit industry group dedicated to advancing Ethernet technology via initiatives aimed at improving interoperability and network performance. The original focus of the group was on bringing Ethernet into the mainstream, but the Ethernet Alliance has since moved forward to encourage the development of new Ethernet technologies in the face of skyrocketing demand for bandwidth.

John D’Ambrosia, chair of the Ethernet Alliance weighed in on the focus of the Ethernet Alliance at SC11, expanding on their interoperability goals and describing the overall role of Ethernet technologies in HPC.

HPCwire: What is the Ethernet Alliance demo showcasing at SC11?

John D’Ambrosia: The Ethernet Alliance is hosting an integrated, multi-vendor demo at SC11 showcasing Ethernet as the optimal solution for all datacenter needs. Ethernet, with its broad family of solutions and its roadmap to ever-higher speeds, is that protocol.

The demo highlights Ethernet’s capacity for seamless interoperability and highlights dependable, high-performance, low-cost solutions like 10GBASE-T, as well as advancements like 40 Gigabit Ethernet (40 GbE). Data center architects can continue to rely on Ethernet, and look to enhanced and emerging Ethernet transport technologies to achieve their ultimate goals.

The display further demonstrates 40 GbE as the next throughput and bandwidth stepping stone for data center applications, which inherently will establish the future upgrade path to 100 Gigabit Ethernet (100 GbE).

HPCwire: What Ethernet technologies are gaining in importance in HPC?

D’Ambrosia: There are several important technologies beginning to take hold in the HPC space. For example, RDMA over Converged Ethernet (RoCE) is a relatively new but promising transport that continues to gain traction in today’s datacenters.

Internet Wide Area RDMA Protocol (iWARP) is a proven remote direct memory access (RDMA) over Ethernet that has been ratified by the Internet Engineering Task Force (IETF). Providing cloud-ready transport with several large clusters scaled to thousands of nodes already in use, it negates the use of esoteric, risky networking and storage technologies requiring a complex amalgamation of routers, gateways, switches, software, and expertise to make HPC clusters excel.

Before the ratification of Data Center Bridging (DCB) in 2010, most datacenters have relied on Fiber Channel (FC) for lossless storage environments that could be used with confidence. With the advent of DCB, Fiber Channel over Ethernet (FCoE) has become a reality – enterprise datacenter architects can leverage current Fiber Channel investments while capitalizing on greater freedom of choice. It is now possible to migrate to increasingly popular Ethernet SAN and NAS file systems, yet maintain the lossless environment required for storage. Furthermore, with today’s ratified Ethernet-based iSCSI and FCoE storage transports, datacenter architects can now choose from a diverse array of interoperable, standard-based vendors.

10GBASE-T illustrates one of Ethernet’s solutions to deploying higher speeds for even conventional IT LAN solutions. Furthermore Ethernet, with its 40GbE and 100GbE families, is keeping apace of the continuing evolution of the PCIe bus on the motherboard, thus enabling 40 GbE and 100 GbE-based servers in the future.

HPCwire: Why interoperability is so important?

D’Ambrosia: Interoperability is critical not only because it offers consumers the ability to find solutions that best fit their needs, but also minimizes the threat of being locked into a single vendor or proprietary technology – undesirable situations for a myriad of reasons.

Proprietary, non-standard based technologies can trap users into a one-dimensional world where there are few choices outside of the chosen proprietary standard and an inability to change to a new one better fitting evolving datacenter needs. Choosing an Ethernet solution enables selecting product offerings from multiple vendors. 

HPCwire: Can you describe the migration path in HPC applications?

D’Ambrosia: In particular to HPC computational clusters, Ethernet has numerous advantages and unparalleled flexibility that suit Supercomputing well both today and far into the future.

As previously mentioned, iWARP is well-established, cloud-ready, supported by multiple chip vendors, and has several large node cluster use cases. The newly formed RoCE protocol also allows InfiniBand users to easily migrate to Ethernet, casting off the need for special switches and gateways required when using multiple protocols.  

HPCwire: What’s the most important take-away today about Ethernet for anyone in HPC? Where do you see it going in the future?

D’Ambrosia: The most important take away by far is that Ethernet, while being more than 40 years old when developed by Xerox PARC in Palo Alto, CA, is continually evolving and adapting as the mainstay for everyone’s networking needs.

The current Ethernet roadmap leads from 1G LAN on Motherboard (LOM) to 10, 40, and 100GbE.  It is a real world-tested and proven, ubiquitous protocol capable of meeting both current and future networking needs ranging from Supercomputing down to consumer LANs. Additionally, Ethernet’s ability to adapt to new and future DC needs negates costly investments – such as new equipment, software, and acquiring needed expertise – into new technologies. And with its unique range of application, from supercomputers to home networks, Ethernet’s technology superiority remains unmatched.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Q&A with Altair CEO James Scapa, an HPCwire Person to Watch in 2021

May 14, 2021

Chairman, CEO and co-founder of Altair James R. Scapa closed several acquisitions for the company in 2020, including the purchase and integration of Univa and Ellexus. Scapa founded Altair more than 35 years ago with two Read more…

HLRS HPC Helps to Model Muscle Movements

May 13, 2021

The growing scale of HPC is allowing simulation of more and more complex systems at greater detail than ever before, particularly in the biological research spheres. Now, researchers at the University of Stuttgart are le Read more…

Behind the Met Office’s Procurement of a Billion-Dollar Microsoft System

May 13, 2021

The UK’s national weather service, the Met Office, caused shockwaves of curiosity a few weeks ago when it formally announced that its forthcoming billion-dollar supercomputer – expected to be the most powerful weather and climate-focused supercomputer in the world when it launches in 2022... Read more…

AMD, GlobalFoundries Commit to $1.6 Billion Wafer Supply Deal

May 13, 2021

AMD plans to purchase $1.6 billion worth of wafers from GlobalFoundries in the 2022 to 2024 timeframe, the chipmaker revealed today (May 13) in an SEC filing. In the face of global semiconductor shortages and record-high demand, AMD is renegotiating its Wafer Supply Agreement and bumping up capacity. Read more…

Hyperion Offers Snapshot of Quantum Computing Market

May 13, 2021

The nascent quantum computer (QC) market will grow 27 percent annually (CAGR) reaching $830 million in 2024 according to an update provided today by analyst firm Hyperion Research at the HPC User Forum being held this we Read more…

AWS Solution Channel

Numerical weather prediction on AWS Graviton2

The Weather Research and Forecasting (WRF) model is a numerical weather prediction (NWP) system designed to serve both atmospheric research and operational forecasting needs. Read more…

Hyperion: HPC Server Market Ekes 1 Percent Gain in 2020, Storage Poised for ‘Tipping Point’

May 12, 2021

The HPC User Forum meeting taking place virtually this week (May 11-13) kicked off with Hyperion Research’s market update, covering the 2020 period. Although the HPC server market had been facing a 6.7 percent COVID-re Read more…

Behind the Met Office’s Procurement of a Billion-Dollar Microsoft System

May 13, 2021

The UK’s national weather service, the Met Office, caused shockwaves of curiosity a few weeks ago when it formally announced that its forthcoming billion-dollar supercomputer – expected to be the most powerful weather and climate-focused supercomputer in the world when it launches in 2022... Read more…

AMD, GlobalFoundries Commit to $1.6 Billion Wafer Supply Deal

May 13, 2021

AMD plans to purchase $1.6 billion worth of wafers from GlobalFoundries in the 2022 to 2024 timeframe, the chipmaker revealed today (May 13) in an SEC filing. In the face of global semiconductor shortages and record-high demand, AMD is renegotiating its Wafer Supply Agreement and bumping up capacity. Read more…

Hyperion Offers Snapshot of Quantum Computing Market

May 13, 2021

The nascent quantum computer (QC) market will grow 27 percent annually (CAGR) reaching $830 million in 2024 according to an update provided today by analyst fir Read more…

Hyperion: HPC Server Market Ekes 1 Percent Gain in 2020, Storage Poised for ‘Tipping Point’

May 12, 2021

The HPC User Forum meeting taking place virtually this week (May 11-13) kicked off with Hyperion Research’s market update, covering the 2020 period. Although Read more…

IBM Debuts Qiskit Runtime for Quantum Computing; Reports Dramatic Speed-up

May 11, 2021

In conjunction with its virtual Think event, IBM today introduced an enhanced Qiskit Runtime Software for quantum computing, which it says demonstrated 120x spe Read more…

AMD Chipmaker TSMC to Use AMD Chips for Chipmaking

May 8, 2021

TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs – with 64 cores operating at a base cl Read more…

Fast Pass Through (Some of) the Quantum Landscape with ORNL’s Raphael Pooser

May 7, 2021

In a rather remarkable way, and despite the frequent hype, the behind-the-scenes work of developing quantum computing has dramatically accelerated in the past f Read more…

IBM Research Debuts 2nm Test Chip with 50 Billion Transistors

May 6, 2021

IBM Research today announced the successful prototyping of the world's first 2 nanometer chip, fabricated with silicon nanosheet technology on a standard 300mm Read more…

AMD Chipmaker TSMC to Use AMD Chips for Chipmaking

May 8, 2021

TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs – with 64 cores operating at a base cl Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

GTC21: Nvidia Launches cuQuantum; Dips a Toe in Quantum Computing

April 13, 2021

Yesterday Nvidia officially dipped a toe into quantum computing with the launch of cuQuantum SDK, a development platform for simulating quantum circuits on GPU-accelerated systems. As Nvidia CEO Jensen Huang emphasized in his keynote, Nvidia doesn’t plan to build... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

Microsoft to Provide World’s Most Powerful Weather & Climate Supercomputer for UK’s Met Office

April 22, 2021

More than 14 months ago, the UK government announced plans to invest £1.2 billion ($1.56 billion) into weather and climate supercomputing, including procuremen Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire