Crash and Boom: Inside the 10GbE Adapter Market

By Scott Schweitzer

November 12, 2013

It may be hard to believe, but we’re coming up on ten years with 10GbE as an adapter option for servers and workstations.

In  2003 the first 10GbE network adapters based on a new breed of chips hit the market—and by 2006, the list had eventually grown to include nearly twenty (AdvancedIO, Broadcom, Chelsio, Intel, Emulex, Endace, Mellanox, Myricom, Napatech, NetEffect, Neterion, NetXen, QLogic, ServerEngines, SMC, Solarflare, Teak Technologies, and Tehuti Networks).

Designing & building a 10GbE ASIC is not a cheap undertaking. Even on a shoestring budget it could easily run $7-10M for that first working chip. Some of these companies never made it past that initial functional 10GbE controller chip. The above combined efforts represent nearly one quarter of a billion dollars to launch the 10GbE adapter market. To remain in this market long term most companies have had to follow Moore’s law crafting new chips every two years.  A significant number of the above companies couldn’t generate enough revenue or continue to secure substantial outside investment to sustain this level of development, and have since been acquired or faded away. So what can be learned from these startups?

With two rounds of investment totaling $47M, and four years, in the summer of 2008 NetEffect was the first one to crash. Originally launched from the remains of a failed Infiniband startup called Banderacom. This isn’t uncommon as silicon designs, like aluminum cans, are often recycled.  NetEffect believed their “secret sauce” was adapting Infiniband functionality, actually RDMA, and overlaying it on Ethernet. The actual feature set was branded iWARP, Internet Wide Area RDMA Protocol. NetEffect’s line of 10GbE adapters was launched in May 2007, and the market tested iWARP. There were several early high profile tire kickers, but one year later, after waiting for NetEffect to enter chapter 11, Intel stepped in, and picked up their intellectual property for $8M. Some might consider this strange, but Banderacom’s Infiniband roots were tied to Intel’s original VIA architecture. Intel has a real eye for bargain hunting, this expanded their 10GbE portfolio, and added 30 engineers. The intellectual property fueled by this $47M, and purchased by Intel for $8M still exists in Intel’s product line as several over priced “NetEffect Ethernet Server Cluster” adapters. Sadly, it appears that these products haven’t been touched since 2009. This may not be the last we see of iWARP.

In 2005 Teak Technologies appeared with a $3M series A, and received some early press, but by late 2008 they’d vanished.  Their Internet domain winked off-line, and the founder had updated his Linkedin profile indicating that he’d moved on. Very little is known regarding what happened to them, and we’re not sure whom if anyone ever actually used their silicon.

Tehuti Networks was launched in 2003 through an Israeli government sponsored incubator. Their focus has appeared to be purpose built systems utilizing blade, ATCA, etc… which implies they are likely producing Israeli defense products. In 2005 they required a series A round of $4.2M to keep moving forward.  In 2008 they took another round of funding, but the particulars were never published. Then in February of 2013 a press release appeared offering a one watt 10GbE NIC chip for $10 in quantities of 1,000. Tehuti is still small, under fifty employees, but only five show up in Linkedin which implies that they consider what they’re doing classified. This further supports the presumption that Tehuti is more focused on the Israeli embedded military computing market than they are on 10G Ethernet.

2009 Brought the 11th hour purchase of NetXen by QLogic for $21M. Founded in January 2002 NetXen launched their first 10GbE adapter in  March of 2006. To do this they needed a series A round in June of 2005 of nearly $15M. How much total capital they consumed over those seven years isn’t exactly clear. Compared to Intel’s acquisition of NetEffect this wasn’t a bargain, but it was still a good deal. Early on HP had bought heavily into NetXen’s story, and product line. They were HP’s default 10GbE configuration, which was a very enviable position. Unfortunately their power hungry controller, which required a fan on the heat sink, never gained serious traction in the market. Which explains why they were only in production for three years. Netxen taught us how valuable an early linkage with a major OEM like HP can be to raising your profile in the market. Compared to NetEffect this OEM connection contributed to NetXen having two additional years to reach profitability, unfortunately in the end that wasn’t enough.

Feeling the pressure from QLogic’s acquisition, and fearing the future threat posed by Fibre Channel over Ethernet (FCoE) Emulex expanded their portfolio into 10GbE in the spring of 2010 with the purchase of ServerEngines in a deal whose total cost was $81M.  ServerEngines had several early, and significant, 10GbE wins with IBM that Emulex had admired, this IBM OEM connection dramatically improved their final valuation. Furthermore, unlike NetXen, ServerEngines was moving forward, and had a staff of 170, mostly engineers. This acquisition quickly added 10GbE to Emulex’s line card. What Emulex found out later though was that ServerEngines had infringed on Broadcom’s patents.  Settling this legal issue cost Emulex an additional $58M, bringing the actual cost of ServerEngines to a staggering $139M. The ServerEngines team though still continues to produce, their latest Skyhawk (40GbE) silicon should be coming out soon. ServerEngines once again proved that a solid OEM relationship added significant value to their acquisition.

Neterion started in 2001 as S2io, and was likely one of the earliest, and clearly one of the hungriest for capital in this market. To produce their first chip S2io had to consume two rounds of funding totaling $27M, and in the Fall of 2003 they deliver their initial XFrame 10GbE server adapter for $4,990.  At that point the only other adapter was Intel’s priced at a staggering $7,995 higher. By June of 2004 S2io needed more capital so they closed a series C round for $42M, bringing the total investment to $69M. In January of 2005, just prior to bringing their second 10GbE controller chip to market, they renamed themselves Neterion. Neterion had also seen value in iWARP, and rolled this into their feature set. In March of 2005, nearly a year ahead of the rising tide of 10GbE adapters Neterion launched their second 10GbE product line. Neterion had partnered with SUN Microsystems for this product launch, and later that summer they continued down the Unix path and announced a partnership with IBM’s Power server group. The market perception was that Neterion’s boards were were not tightly integrated which significantly drove up their production costs and power consumption. Their initial products were full height, full length boards while at the same time competitors were offering similar feature sets in half height short cards. Neterion continued to burn capital, requiring additional outside funding, but alas in 2010 they were picked up by Exar for $10M.

Endace took a slightly different approach than most and leveraged its FPGA adapter products to also build appliances, which they then wrapped consulting services around. This broadened their product line, and increased their margin. More importantly though, while everyone else in the market was selling adapters then moving on, consulting enabled Endace to more tightly connect with their customers. This deeper connection educated Endace in a unique way providing them with more detailed customer requirements in the area of Ethernet monitoring & measurement. This enabled them to further tune their appliances to more closely align with the needs of the market.  In 2012 Emulex’s Software Solutions team had partnered with Endace. The partnership was designed to link Emulex’s OneCommand management software to Endace’s appliances so Emulex could expand out of Fibre Channel management into the much larger Ethernet environment. Eventually the partnership lead to the acquisition of Endace earlier this year for $130M.

Myricom is the most recent privately held 10GbE company to fall.  After nearly twenty years, most of it in the High Performance Computing (HPC) market, it was announced earlier this month that a customer of theirs, CSPi of Billerica Mass, had acquired them. In 2006 Myricom crossed over from HPC to Ethernet when they released a line of 10G adapters that were both HPC interconnect NICs and generic 10G Ethernet NICs. For the past 15 years CSPi has been the only significant volume consumer of Myricom’s silicon. These chips were used by CSPi’s MultiComputer division to fabricate purpose built imbedded clusters for defense department projects. According to Linkedin in March of this year Myricom’s former CEO, CTO, several Senior Software Architects, and a significant number of other PHds departed from Myricom and joined Google. Why this happened is still not public, but clearly it’s what lead to the eventual acquisition by CSPi.

So from the original eighteen we’re down to half leaving us with: AdvancedIO, Broadcom, Chelsio, Emulex, Intel, Mellanox, Napatech, QLogic, SMC & Solarflare. Six of the remaining are  publicly traded companies, and most are fairly sound. That leaves only four 10GbE startups: AdvancedIO, Chelsio, Napatech & Solarflare. Napatech, an FPGA based network adapter company, applied on October 24th to the Oslo exchange for an initial public offering. In their filing they stated that their 2012 revenue was $31M. This infusion of cash should fuel their recent push into the next new market, 40GbE adapters. Both Chelsio & Solarflare have announced 40GbE products this quarter, so they too will be moving on. Furthermore each has dominated the market in the initial profitable niche they carved out. Chelsio leads in10GbE iSCSI storage controllers. Early on Solarflare targeted High Frequency Trading (HFT), and as a result 90% of the world’s equities trades happen on server networks powered by Solarflare. Alas, AdvancedIO out of Canada appears to be the one left behind. They haven’t announced plans to move to 40GbE, and haven’t had much success expanding out of their initial Aerospace & Defense market.

So after ten years, and eight 10GbE startups having vanished what have we learned? Four things: partner with a tier one OEM when you have the engineering to support it, continue to innovate, diversify your product line through both hardware & software, and dominate one niche of the market before expanding out. As we saw with several of these startups you need to partner early with two or more top tier OEMs, preferably IBM & HP to help extend your market reach. Tier one OEMs are costly to deal with, demanding & process driven, but they’re global, and in many markets that startups will never reach on their own. These partnerships can extend a startup’s life by several years, and dramatically improve its value. To remain competitive startups must keep the chip crank turning, and continuing to innovate, you can bet their competition is. Several of the failed startups never made it past their first or second 10GbE controller chip. The remaining startups have all done four or more chip generations. Diversify beyond ethernet adapters. Endace caught Emulex’s eye because they had an appliance solution, Emulex was already in a partnership with another 10GbE adapter provider, and had their own ServerEngines 10GbE silicon. In the end Emulex acquired Endace for $130M because they had something substantially more valuable. Solarflare & Myricom both realized that adding high value software to their portfolios is another successful approach. Also Solarflare’s expansion of their ASIC based 10GbE controller line to also include FPGAs with very market specific software should further drive adoption in other very profitable niche markets. Finally, dominate your core market niche then expand out to dominate other niches within that market.

So where do we go from here? Simple, all the remaining players now have to ante up at the 40GbE table, and perhaps some new ones will sit down.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Graphcore Introduces Larger-Than-Ever IPU-Based Pods

October 22, 2021

Graphcore and its “Intelligent Processing Units” (IPUs) emerged from stealth in 2016 and launched its second-generation IPU in 2020. While the company has also launched its IPUs in a variety of form factors over the Read more…

Quantum Chemistry Project to Be Among the First on EuroHPC’s LUMI System

October 22, 2021

Finland’s CSC has just installed the first module of LUMI, a 550-peak petaflops system supported by the European Union’s EuroHPC Joint Undertaking. While LUMI -- pictured in the header -- isn’t slated to complete i Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat for that approach), announced it was expanding into gate-based Read more…

LLNL Prepares the Water and Power Infrastructure for El Capitan

October 21, 2021

When it’s (ostensibly) ready in early 2023, El Capitan is expected to deliver in excess of two exaflops of peak computing power – around four times the power of Fugaku, the current top-ranked supercomputer in the wor Read more…

AWS Solution Channel

Royalty-free stock illustration ID: 537899029

Running GROMACS on GPU instances

Comparing the performance of real applications across different Amazon Elastic Compute Cloud (Amazon EC2) instance types is the best way we’ve found for finding optimal configurations for HPC applications here at AWS. Read more…

Faster Optical Switch that Operates at ‘Room Temp’ Developed by IBM, Skolkovo Researchers

October 19, 2021

Optical switching technology holds great promise for many applications but hot operating temperatures have been a key obstacle slowing progress. Now, a new optical switching device that can operate at room temperatures a Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat fo Read more…

LLNL Prepares the Water and Power Infrastructure for El Capitan

October 21, 2021

When it’s (ostensibly) ready in early 2023, El Capitan is expected to deliver in excess of two exaflops of peak computing power – around four times the powe Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Quantum Workforce – NSTC Report Highlights Need for International Talent

October 13, 2021

Attracting and training the needed quantum workforce to fuel the ongoing quantum information sciences (QIS) revolution is a hot topic these days. Last week, the U.S. National Science and Technology Council issued a report – The Role of International Talent in Quantum Information Science... Read more…

Eni Returns to HPE for ‘HPC4’ Refresh via GreenLake

October 13, 2021

Italian energy company Eni is upgrading its HPC4 system with new gear from HPE that will be installed in Eni’s Green Data Center in Ferrera Erbognone (a provi Read more…

The Blueprint for the National Strategic Computing Reserve

October 12, 2021

Over the last year, the HPC community has been buzzing with the possibility of a National Strategic Computing Reserve (NSCR). An in-utero brainchild of the COVID-19 High-Performance Computing Consortium, an NSCR would serve as a Merchant Marine for urgent computing... Read more…

UCLA Researchers Report Largest Chiplet Design and Early Prototyping

October 12, 2021

What’s the best path forward for large-scale chip/system integration? Good question. Cerebras has set a high bar with its wafer scale engine 2 (WSE-2); it has 2.6 trillion transistors, including 850,000 cores, and was fabricated using TSMC’s 7nm process on a roughly 8” x 8” silicon footprint. Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

US Closes in on Exascale: Frontier Installation Is Underway

September 29, 2021

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, held by Zoom this week (Sept. 29-30), it was revealed that the Frontier supercomputer is currently being installed at Oak Ridge National Laboratory in Oak Ridge, Tenn. The staff at the Oak Ridge Leadership... Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer... Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

AMD-Xilinx Deal Gains UK, EU Approvals — China’s Decision Still Pending

July 1, 2021

AMD’s planned acquisition of FPGA maker Xilinx is now in the hands of Chinese regulators after needed antitrust approvals for the $35 billion deal were receiv Read more…

Leading Solution Providers

Contributors

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

Quantum Roundup: IBM, Rigetti, Phasecraft, Oxford QC, China, and More

July 13, 2021

IBM yesterday announced a proof for a quantum ML algorithm. A week ago, it unveiled a new topology for its quantum processors. Last Friday, the Technical Univer Read more…

The Latest MLPerf Inference Results: Nvidia GPUs Hold Sway but Here Come CPUs and Intel

September 22, 2021

The latest round of MLPerf inference benchmark (v 1.1) results was released today and Nvidia again dominated, sweeping the top spots in the closed (apples-to-ap Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Unveils New Node Names; Sapphire Rapids Is Now an ‘Intel 7’ CPU

July 27, 2021

What's a preeminent chip company to do when its process node technology lags the competition by (roughly) one generation, but outmoded naming conventions make i Read more…

Frontier to Meet 20MW Exascale Power Target Set by DARPA in 2008

July 14, 2021

After more than a decade of planning, the United States’ first exascale computer, Frontier, is set to arrive at Oak Ridge National Laboratory (ORNL) later this year. Crossing this “1,000x” horizon required overcoming four major challenges: power demand, reliability, extreme parallelism and data movement. Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire