Visit additional Tabor Communication Publications
May 09, 2012
Myricom and Emulex are teaming up to bring a series of network offerings to market targeted for high performance applications. The partnership will kick off with Emulex reselling Myricom 10GbE products into selected application domains, but the end game is to go after the high-flying InfiniBand market with products based on Emulex's Ethernet ASICs and Myricom's high performance software.
Essentially the collaboration is about leveraging Myricom's low latency/high bandwidth interconnect smarts with Emulex's more developed roadmap for Ethernet and its considerably deeper market reach. For Emulex, this is somewhat of a mid-course correction on its plans to bring converged networking to the masses. The company, which started out in the Fibre Channel space, jumped on the converged Ethernet bandwagon at a time when everyone believed datacenter traffic was destined to travel down a single pipe.
According to Shaun Walsh, Emulex's SVP of Marketing, that level of convergence hasn't happened yet, except perhaps in microcosm of blade servers, where density and power issues naturally moves them toward consolidated architectures. Some of that convergence will work its way into rack-mounted servers, says Walsh, thanks in part to the new Intel Sandy Bridge E5 Xeons, which are more friendly to virtualized networking designs.
But under this umbrella of convergence, there still exists a need for a variety of network technologies optimized for different types of applications. For example, multimedia streaming, which is heavily dependent on network bandwidth, requires a different type of fabric than that of high frequency trading (HFT), where low latency is the name of the game.
That's where Myricom comes in. As a networking vendor with deep roots in high performance computing, the company has developed a series of Ethernet cards and software packages aimed at performance-challenged applications of various stripes. Today, Myricom offers three such network acceleration software packages, all under its FastStack moniker: DBL, which delivers ultra-low latency for UDP and TCP (2.9µs and 3.8µs, respectively) primarily for HFT applications; Sniffer10G, which is optimized for maxing out packet rates on a variety of apps (analytics, network security/surveillance, measurement and packet generation, and DDoS defense appliances); and VideoPump, a software stack that speeds data streaming (over 25,000 streams at 3Mb/sec) for render farms and digital content providers.
In the short-term, Emulex will resell existing Myricom 10GbE cards, under Emulex's OneConnect brand, bundled with the software acceleration packages mentioned above. In this initial phase of the partnership, it's all based on Myricom technology; Emulex will provide sales and marketing heft only. "The big push for us right now is to provide expanded channels," says Walsh.
The next phase of the partnership will entail integrated product development, where Emulex supplies its 40GbE network ASIC for the next generation of adapter cards. These products will incorporate RDMA over Ethernet technology, and along with Myricom software, provides a broader entry into the high performance networking market than neither of these companies could manage on its own. Walsh says these 40 Gig products should be ready to roll toward the end of the year, adding that 100GbE products are in the pipeline as well.
According to Walsh, the Emulex-Myricom combo is out to "beat up Mellanox," reflecting their intention to invade InfiniBand's high performance turf. That encompasses applications in HPC stronghold of scientific computing as well the those in commercial realm. In the latter case, the need for low latency, high bandwidth, and minimizing CPU utilization are driving more business workloads to behave like high performance applications from a network point of view.
Walsh thinks its upcoming 40 Gig offering will be able to go head-to-head with InfiniBand in this high-end networking niche, especially with the right software stack behind it. In fact, he believe two-thirds or more of that market is destined to end up in the Ethernet column over the next four years.
That assertion is supported by Crehan Research, which projects that revenue from high performance networking is expected to be dominated by 10GbE and 40GbE solutions by 2016. Analysts there see a 13 percent compounded annual growth rate for InfiniBand during the first six years of the decade, while 10GbE and 40GbE revenue is expected to grow by 33 percent and 264 percent, respectively in this same timeframe.
It's worth noting that Mellanox is attacking the high performance networking space with both its traditional InfiniBand offerings and its newer Ethernet switches and NICs (based on its SwitchX and ConnectX ASICs, respectively). And that company has 40GbE products in the field today.
Whether latency- and bandwidth-sensitive applications actually opt for 40GbE over FDR and EDR InfiniBand is still a question mark and is likely to be a decision made on a case-by-case basis. Walsh maintains that with RDMA over Ethernet, latency is now on par with that of InfiniBand, although the latter's sub-microsecond values still have an edge for the most demanding applications. For raw bandwidth, InfiniBand looks to maintain its lead for the foreseeable future. The current FDR InfiniBand NICs can deliver 54 Gbps of real data in a four-lane setup, while future EDR adapters will net 100 Gbps. By the time 100GbE arrives, InfiniBand will likely already have moved to HDR, a post-100Gbps data rate that has yet to be nailed down.
But according to Myricom CEO Nan Boden, the majority of applications (outside of some supercomputing codes) aren't designed to take advantage of those bleeding-edge data pipes. "The bandwidth playing field is becoming more or less level," she asserts. "I don't mean on the micro-benchmarks and signaling rates, but on what we're delivering inside applications. And for that, Ethernet is catching InfiniBand bandwidth with 40 Gig."
In any case, the much larger Ethernet ecosystem is apt to draw in a greater share of performance-minded users as the capabilities of the two technologies narrow. Also, given the sale of QLogic's InfiniBand assets to Intel and its uncertain future there, InfiniBand is starting to look like a one-vendor ecosystem based solely on Mellanox hardware and software. That is likely to limit its wider adoption for more commercial applications.
Emulex, of course, has plenty of competition on the Ethernet side, with other vendors vying for customers 10GbE and 40GbE business. Today, the Emulex is number two in overall 10GbE revenue (to Intel) and number one in total port shipments, according Crehan Research and Dell'Oro Group. With Myricom technology in the mix, Walsh says they expect to surpass Intel in revenue by next year.
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
May 10, 2013 |
Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
May 09, 2013 |
The Japanese government has revealed its plans to best its previous K Computer efforts with what they hope will be the first exascale system...
May 08, 2013 |
For engineers looking to leverage high-performance computing, the accessibility of a cloud-based approach is a powerful draw, but there are costs that may not be readily apparent.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.