As we reported yesterday, the five venture capital firms supporting Linux cluster vendor SiCortex have pulled their funding, forcing the Massachusetts-based company to shut down its operations. As the company prepares to sell off its assets, there are said to be only a handful of employees remaining. Unless a buyer comes in that is willing to take over the business more or less intact, support for dozens of SiCortex systems currently deployed at user sites will come to an abrupt end.

As of today, the company had 37 customers listed on their Web site, including such big names as Argonne National Lab, MIT, NASA, Karlsruhe Institute of Technology, Chevron, and General Electric. More than 20 universities had also purchased SiCortex gear. Undoubtedly, some of these customers will be able to migrate their HPC applications onto spare capacity as they phase out their orphaned SiCortex machines. For others though, the transition is going to be a very painful one.

I spoke with a university customer who had purchased a mid-range SiCortex cluster, where it represents the institution's newest HPC platform. The system administrator there, who requested to remain anonymous, was wondering what they were going to do without vendor support. "This really puts us in a huge bind," he told me.

According to him, the university shelled out around $150,000 for the SiCortex cluster, the largest investment ever made at this particular lab. They had planned for the system to be their HPC platform of the future, where it was supposed to augment the lab's aging x86-based clusters. SiCortex was chosen because of space and power constraints at the datacenter, and because university researchers there were working on computational models that scaled extremely well for high core-count architectures. Compared to conventional x86 clusters, SiCortex systems use greater numbers of less powerful MIPS cores to deliver some of the best performance per watt metrics in the industry.

The SiCortex design has garnered a lot of critical acclaim, but according to my system admin source, it hasn't been exactly smooth sailing with the company's hardware. He said while the SiCortex's support and service has been "outstanding," the machines themselves have had their problems. The first system purchased by the university, the SC648, didn't live up to its advertised performance. The company ended up swapping the system with the more powerful SC1458 machine. However, even this system has been trouble. According to the system administrator, during the 16 to 18 months the system has been running, they have not gone for a consecutive four month span without some kind of hardware failure.

Currently two of the 235 compute nodes on the system are down. While that is probably not an outlandish failure rate considering the size of the cluster, without vendor support, the lifetime of such a machine will be greatly reduced. The real fear is that a critical failure could occur at any time, rendering the system totally worthless.

One unfortunate consequence of SiCortex's demise is that, for awhile at least, there will be no high core-count HPC platform in the price range of a mid-sized cluster, and with the performance efficiency of an IBM Blue Gene. Sometime in the first half of 2010, you should be able to get an 8-socket, 8-core Nehalem-EX server that supports 128 threads. A dozen of these servers would provide over 1,500 threads, more or less equivalent to a 1,458-core SiCortex machine, at least thread-wise. But the price and power consumption (not to mention performance) of a Nehalem cluster of this size are likely to be a good deal more than the equivalent SiCortex system.

The broader tragedy is that the company appeared headed for commercial success. According to my last conversation with the company in April, the business had achieved record growth in Q1, and had collected a big pipeline of customers for the remainder of 2009. SiCortex was already pitching its more powerful next-generation systems (more cores and faster processors). If the VCs hadn't blinked, the company may have begun to turn a profit this year or next, despite the economic downturn.

The result of SiCortex's demise is that HPC users will likely become even more conservative in their choice of cluster vendors. If they can. For the university in this story, there are no easy answers since the funds may not be there to replace the SC1458 system anytime soon. Even if they were, the researchers were getting used to running their apps on a high-core count machine. "We'll figure something out," said the system admin. "But in the meantime, my scientists are freaking."

-----

[ UPDATE:  For a couple of great perspectives from former employees at SiCortex, check out Matt Reilly's blog here and Jeff Darcy's comments on his Web site.]