Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags
September 10, 2009

Low Latency 10 GigE Looks to Build HPC Cred

Michael Feldman

It’s probably no coincidence that at next Monday’s High Performance Computing on Wall Street event, two of the conference headliners will be touting the joys of 10 Gigabit Ethernet for the financial digerati. Arista Networks founder Andy Bechtolsheim and BLADE Network Technologies CEO Vikram Mehta will explain why low latency 10 GigE technology has become so important to financial applications.

Since the demise of Woven Systems this past May, Arista and BLADE appear to be the only two remaining Ethernet vendors offering “ultra-low-latency” switching in a lossless fabric. The term “ultra” has no exact meaning, but since both vendors are touting sub-microsecond port-to-port latencies in their switch boxes, we can use that as an approximate definition. Sub-microsecond switch latency brings Ethernet into the InfiniBand realm, and makes this technology suitable for all sorts of HPC mischief.

Although the deployment of 10 GigE into HPC has been occurring in slow motion, 2009 may finally be the year it takes off. In July, Purdue University announced “Coates,” a new 10 GigE supercomputer cluster that is expected to nab a top 50 spot on the next TOP500 list. And this week, Linux Magazine’s Douglas Eadline outlined some reasons why he believes 10 GigE will start to gain significant traction in HPC over the 12 months.

My 10 GigE prediction is based on the following rule of thumb, Speed, Simplicity, Cost, pick any two. I believe 10 GigE will win because of simplicity and cost. IB is already faster and has better latency and if you need this level of performance you are not even looking at Ethernet direction. The joy of clustering is that one size does not fit all and you can build your cluster around your needs.

The expectation is that 10 GigE LAN-on-motherboard controllers will become commonplace on servers over the next 12 months and will tip the economic equilibrium toward the new technology. And thanks to faster switch ASICs and more mature software, lower-cost switches from companies like Arista and BLADE will also help to bring 10 GigE into mainstream service.

Today, both companies are offering top of rack switches in the $400 to $500 per port range. BLADE’s Mehta recently told me they intend to be the first ones to break the $100 per port barrier, which would put it on par with high-end Ethernet switch pricing. And unlike Woven Systems, BLADE and Arista look to be at least reasonably financially stable.

BLADE, a private company, just announced its best quarterly revenues for Q309. According to Dell’Oro Group’s Q209 Ethernet Switch Quarterly Report, the company is now the third largest supplier of 10 GigE switches, although Cisco still owns the lion’s share of the market. (Purdue’s Coates super mentioned above is based on Cisco and Chelsio network gear.) However, in the wake of Cisco’s entrance into the server business, BLADE has aggressively gone after Cisco OEM partners, who now see the big network vendor as direct competition. Today BLADE’s OEM relationships extend to IBM, HP, NEC and Verari Systems and are starting to pay dividends. The company says it has collected over 9,000 customers spread over 26 industry verticals.

BLADE also just completed $10 million in Series B funding, bringing on board three new investors: NEC, Juniper Networks, and an unnamed new investor, which Mehta characterized as a “big technology powerhouse.” The investment from Juniper Networks is an interesting one, inasmuch as Juniper is also an Ethernet switch vendor. But the two companies have collaborated before — although the exact nature of that collaboration remains somewhat of a mystery — which could lead one to believe that these kids might get married someday, and present a more formidable threat to Cisco.

The younger Arista is not nearly as far along as BLADE, business-wise. On Dell’Oro’s Ethernet switch report, the company doesn’t even show up on the list, since presumably its market share is less than 0.1 percent, placing it in the “others” category. Nevertheless, the company does have $100 million in committed funding, which is presumably backed up by billionaire Bechtolsheim’s giga-dollars. And since the company started shipping Ethernet switch gear in 2008, Arista has managed to collect around 100 customers, spread across HPC, manufacturing, health care and financial services.

But it’s the latter vertical that has become one of the most interesting for 10 GigE vendors. Despite the fact that both Arista and BLADE have positioned themselves as cloud network providers (along with every other network vendor in existence), today the financial services space provides 30 percent of the revenue for each of these companies. A big chunk of this money is coming from the uber-profitable high frequency trading (HFT) segment, where the cloud computing model is entirely absent. Minimizing latency is at the heart of HFT, which is why both Arista and BLADE have been successful with this particular Wall Street application. In fact, some people just refer to HFT as low latency trading.

In our special coverage of the High Performance Computing on Wall Street conference next week, we’ll delve more deeply into the importance of these companies in the HFT ecosystem and the financial services space in general.

SC14 Virtual Booth Tours

AMD SC14 video AMD Virtual Booth Tour @ SC14
Click to Play Video
Cray SC14 video Cray Virtual Booth Tour @ SC14
Click to Play Video
Datasite SC14 video DataSite and RedLine @ SC14
Click to Play Video
HP SC14 video HP Virtual Booth Tour @ SC14
Click to Play Video
IBM DCS3860 and Elastic Storage @ SC14 video IBM DCS3860 and Elastic Storage @ SC14
Click to Play Video
IBM Flash Storage
@ SC14 video IBM Flash Storage @ SC14  
Click to Play Video
IBM Platform @ SC14 video IBM Platform @ SC14
Click to Play Video
IBM Power Big Data SC14 video IBM Power Big Data @ SC14
Click to Play Video
Intel SC14 video Intel Virtual Booth Tour @ SC14
Click to Play Video
Lenovo SC14 video Lenovo Virtual Booth Tour @ SC14
Click to Play Video
Mellanox SC14 video Mellanox Virtual Booth Tour @ SC14
Click to Play Video
Panasas SC14 video Panasas Virtual Booth Tour @ SC14
Click to Play Video
Quanta SC14 video Quanta Virtual Booth Tour @ SC14
Click to Play Video
Seagate SC14 video Seagate Virtual Booth Tour @ SC14
Click to Play Video
Supermicro SC14 video Supermicro Virtual Booth Tour @ SC14
Click to Play Video