The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
HPC Matters is a joint blog consisting of contributors from the Tabor Communications team on their observations and insights into HPC matters.
November 27, 2008
It happens every year at the Supercomputing Conference and Expo, whether it's seafood in Seattle, pierogies in Pittsburgh, or anchos in Austin. Some days it's a feast, others a famine.
For those of you who, like me, used SC08 as an opportunity to synch up with important contacts, you know the drill. Or rather, you know the two different drills. In drill number one, you eat like a hobbit. After a 7:30 breakfast meeting you have a second breakfast meeting at 8:30. Then it's elevenses with your first lunch, followed by a proper lunch meeting that lasts a full hour. Fill up then, because you won't eat again until the meet-and-greet at 4:30, after which you have back-to-back dinners and at least two catered receptions to attend. You roll back to the hotel, and if you're lucky, you're at the Doubletree, so you can eat a fresh chocolate chip and walnut cookie in bed. (Really, those cookies are very good.)
Drill number two doesn't work that way. For whatever reason, your meetings line up differently the next day, and somehow you keep missing meals. If you're in the Doubletree, that delicious cookie is the only food you sniff all day. The Ritz will fetch you anything you want of course, but at other hotels, you might just go to bed hungry, dreaming of the two brunches you'll have tomorrow.
The food is incidental, of course, and what really matters is what you learn in the time you're there. Just in time for American Thanksgiving, here's a quick feast-or-famine guide to what you could gorge on in the HPC space, versus areas in which the cupboard is bare.
Interconnect Options: Feast
At my second dinner Monday evening, one vendor asked me if I thought InfiniBand could continue to survive with Mellanox as the only chip provider. Of course it could survive, I replied, because our data shows InfiniBand adoption continuing to grow in all interconnect segments. But it was likely that this growth would attract new entrants, and we'd eventually have more than one player. The next day, QLogic announced its own chips, lending a new option to a growing space.
Other sectors of the interconnect market are heating up as well. 10 Gigabit Ethernet has gone mainstream, with a wealth of vendors seeking to differentiate their offerings. The most interesting of these may be Myricom, which has remodeled its business plan to derive a majority of its revenue from 10GbE.
But neither of these developments is where I see the real action heating up over the next two years. The big trend to watch is now optics. Users in many verticals are expressing early interest in optical interconnects because of their potential in lowering latency. Avago, Finisar, Lightfleet, Luxtera, and Obsidian all had presences at SC08, and Tabor Research predicts we'll continue to see more from them over the next two years.
Utility Computing: Feast
Tabor Research surveys have shown a high degree of user interest in cloud computing. In this space, Arista made a splash by landing Silicon Valley visionary Andy Bechtolsheim, who is now championing that company's cloud strategy. In addition, a little-known company called Darkstrand made a big impression with its commercialization of access to supercomputing resources over the National LambdaRail network. Even demos in The MathWorks' booth showcased Amazon EC2. Cloud computing plays into the strengths of IBM and HP, the HPC server leaders, as well as Platform Computing, the leading middleware provider. Tabor Research expects these three companies to capitalize on the opportunity.
Server Vendors' Data Management Strategies: Famine
The evolution of pNFS is the most important story in HPC that no one is paying enough attention to. In beta now, pNFS will likely become a standard option in the first half of 2009 and go mainstream by the end of the year. With data management as one of users' most significant challenges, the server vendor community has yet to fully embrace the landscape shift that will start to take place between now and SC09.
The storage vendors are largely ready. Panasas has been publicly pushing pNFS since early 2007, and companies ranging from BlueArc to NetApp are well-positioned to gain from standardization in the file system arena. On the server side, the readiness is not as apparent, especially considering the big server vendors all sell storage products.
The lone strategic bright spot seems to be on Sun, the same company that popularized InfiniBand as a storage interconnect. Sun's Open Storage strategy is at times confusing but indubitably bold and is the most significant area of Sun differentiation in HPC. Plus, Sun owns Lustre now; I just wish they would do more with it. IBM has GPFS and will continue to ride that train successfully, at least for the near term. HP, Dell, and Cray all need to work on their data management solutions.
Accelerator Options: Feast
The biggest new product news here is NVIDIA's launch of its "personal supercomputer" based on its Tesla GPGPU. This exciting product has unfortunately been labeled with an albatross of a designator -- the industry is rife with failed, oxymoronic personal supercomputers -- but NVIDIA may have the clout and momentum to gain in academic and research markets while the marketing department figures out how to reposition for the industrial sector. The ecosystem around Tesla also continues to grow. NVIDIA partners (notably Acceleware) are pre-packaging Tesla-based solutions, and The Portland Group has been working on its own compilers for GPGPU. Intel's Nehalem CPU is an important consideration in this space, but in this case I think Intel's competitive heat is on AMD more than it is on NVIDIA.
But while everyone has been looking at GPGPU, an older accelerator category has slipped back into the mix: FPGA. Before you scoff, consider that FPGAs excel in areas in which GPGPUs have been weak, especially in scalable, high-bandwidth, text- or integer-based applications. This time around, programmability isn't at issue, because vendors like Convey, BlueArc, and XtremeData have integrated FPGAs into their offerings.
Convey enjoyed a terrific launch, thanks in part to the combined experience of Bruce Toal and Steve Wallach. (An interview with Wallach hit The New York Times during the show.) The FPGA-powered design is a major departure in computing architectures, and Convey could quickly become an interesting second-tier player alongside SiCortex, another differentiated architecture player with a strong SC08 showing.
Bring on the Next Course
Overall the energy of the show was strong, setting another attendance record (although that is as much a factor of the diversity of vendors than anything else). Still, amid these famine-oriented economic conditions, the SC08 floor was a refreshing island of plenty. In our most recent surveys, users indicated their budgets are still expected to grow over the next two years, and judging by the smorgasbord of activity in Austin, we could be ready to feast again in Portland in 2009.
Posted by Addison Snell - November 27 @ 10:48AM
(Digg, Technorati, more)
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
Addison Snell is the CEO of InterSect 360 Research
More Addison Snell
Re: Cray Corrals Big Defense Deal by watchesuk
We think by watchesuk
Re: IBM and HPC by truly64
HPC = servers but a lot more by lawries
Lena by Nastyanna
Lena by Nastyanna
Multi core deployment becomes a memory game by truly64
Re: Venture Capital Drought? Not So Much. by Ron Van Holst
Re: AMD Confirms 12-Core Opteron Production by Nastyanna
Re: Cray Corrals Big Defense Deal by Nastyanna
Re: Podcast: Cray Awarded Defense Deal; SGI Makes Storage Buy; IBM Invents New Algorithm by Nastyanna
Painful Truth by jeffrey.mcallister
SGI = graphics + HPC by johnbarr
HPC = servers but a lot more by truly64
Oracle SPARC != Fujitsu SPARC by Alan M. Feldstein
Sun & HPC != Oracle & HPC by Merblich
a third vendor for lossless low latency 10GbE fabric by lee.fisher@hp.com
Response to GAH by KevinButerbaugh
Response to KevinButerbaugh by GAH
Response to KevinButerbaugh by GAH
Response to GAH by KevinButerbaugh
Response to bdrupp by KevinButerbaugh
Climate Crisis and Exaflops by bdrupp
Climate Crisis and Exaflops by John Hules
Climate Crisis and Exaflops by GAH
Climate Crisis by KevinButerbaugh
IBM "Brain Simulation" article is not properly presented. by Merritt
563 out of 1206 by vvolkov
Little Iron by gadunk
At least it's not "cloud" by KevinButerbaugh
Native QPI Interface? by commike
Mmmmmm by hellcats
New transistorized IC chip scales. by symmecon
Itanium at IDF by Alan M. Feldstein
Communication time by jnapper
"The financial meltdown and computing" by donpellegrino
Human Models by mdgabriel
High-End SPARC Chip for Scientific Applications by Alan M. Feldstein
RapidMind by Mr LolO
Rapidmind by dminor
Longer run times by JohnWest
re: Algo trading Angst by jshore
Results of Testing by in_the_crease
The ACM Turing Award goes to the creator of the modern personal computer; and Voltaire announces a mid-range InfiniBand switch and new technology that accelerates distributed applications. We recap those stories and more in our weekly wrapup.
Read More...
The prospects for virtual SMP technology got another boost last month when Florida State University announced it had installed a new HPC system from 3Leaf Systems. The servers are being housed at the university's HPC facility and will be used across a range of scientific disciplines.
Read More...
For the first time in 62 years, the four-man Olympics bobsled team from the US captured the gold medal, setting a course world record in the process. The winning bobsled had some state-of-the-art engineering behind it, including CFD software from Exa Corporation. As it turned out, that software may have proved to be the margin of difference in the race.
Read More...
Mar 11 | Linux Magazine | CUDA may be the rage, but OpenCL is a standard that has some features you may need. Read more...
Mar 09 | Free Software Magazine | Data-driven computing will need open software. Read more...
Mar 09 | Bio-IT World | Tahoe Informatics founder eyes GPUs, CUDA software. Read more...
Mar 08 | Sporting Life | Formula One engineers differ on benefits of CFD. Read more...
Mar 08 | InfoWorld | AMD offers up 48-core server prize. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html