HPCwire: SSDs Make Entrance into HPC... Finally

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

HPCwire >> Blogs

Blog: From the Editor

September 03, 2009

SSDs Make Entrance into HPC... Finally

Solid-state drives (SSDs) for servers have been around for a few years now, but there hasn't been a big rush to re-outfit datacenters, HPC or otherwise, with this new technology. This week's announcement by the San Diego Supercomputer Center (SDSC) of its new SSD-equipped Appro cluster illustrates the point. In fact, SDSC is touting its supercomputer, called "Dash," as the first large HPC deployment of SSD technology.

The 5 teraflop Dash machine (it's fast, get it?) is mostly just a typical, late-model HPC cluster: Nehalem processor blades hooked up with InfiniBand. Getting all the attention is the flash memory, which is of the Intel SATA SSD variety. Sprinkled on top is ScaleMP's vSMP (virtual SMP) software, which is used to aggregate regular memory and flash memory into virtual "supernodes." Each supernode is made up of 16 physical nodes and encompasses 768 GB of DRAM and 1 TB of NAND. The whole idea is to support super-sized data-mining, in which the big DRAM is used to house large datasets, and the NAND flash is used to turbo-charge file I/O and memory swapping. Applications includes drug discovery and asteroid-hunting, among others.

From the SDSC press release:

“Dash can do random data accesses one order-of-magnitude faster than other machines,” said Allan Snavely, associate director at SDSC. “This means it can solve data-mining problems that are looking for the proverbial ‘needle in the haystack’ more than 10 times faster than could be done on even much larger supercomputers that still rely on older ‘spinning disk’ technology.”

The fact that this is the first large-scale deployment of NAND flash technology in HPC, or maybe in any large-scale cluster, points to the immaturity of the enterprise SSD market. While consumer flash has been mainstream for years in handheld devices and USB thumb drives, server-based flash memory is still in the hype-cycle, although probably toward the end of it. There are plenty of server-based flash products and an array of vendors -- Intel, STEC, Micron, Texas Memory Systems, Fusion-io, SandForce, and Violin Memory, to name a few -- with more on the way. But with no history of product reliability, it's been a battle to overcome the conservative culture of IT managers and the 50-year inertia of hard disk storage.

The fact that the recession has flattened IT budgets has probably not helped. Even in a bad economy, though, flash memory has plenty to recommend it. Compared to spinning disks, it's denser, more energy-efficient, and, from an IOPS point of view, much less expensive. Although there have been concerns about longevity, the current crop of NAND server devices are being advertised with a lifetime of five-plus years, which is more than enough for most datacenters applications.

One confounding factor is the array of architectural and technology choices. Flash SSDs that plug into existing disk slots are the most commonly offered. They're also the least disruptive, inasmuch as they act like hard disks, with, of course, the advantage of greater speed. Less common are PCI-based flash products, offered by Fusion-io and a number of other companies. In this case, the flash devices are hooked up directly to the PCI bus, which avoids the overhead of the disk controller and yields higher IOPS with lower latencies.

NAND memory for servers is usually of the SLC (Single-Level Cell) variety, since the less expensive, consumer-grade MLC (Multi-Level Cell) NAND degrades too rapidly for enterprise duty. However, some server flash vendors uses a mixture of SLC and MLC, along with some intelligent data placement and wear-leveling technology to take best advantage of both NAND technologies.

Sun Microsystems is planning to introduce its own flash DIMMs and use them in its upcoming 4 TB Flash Array 5100. Nothing has been announced yet, but Andy Bechtolsheim (who still seems to be keeping his Sun hobby alive, despite his Arista Networks gig) has talked up the 5100 product in at least a couple of venues, including the MySQL Conference this past spring.

I've embedded Andy's 18-minute conference presentation below. He just makes a brief mention of the 5100, but the rest of the talk is a nice explanation of where SSD technology sits today in the server space.

Posted by Michael Feldman - September 3 @ 5:22PM

(Digg, Technorati, more)

Discussion

There are 0 discussion items posted.

Join the Discussion

You must be a registered user in order to comment on HPCwire stories.

Members enjoy:

	Access to Special Content, including Podcasts, Webcasts, and Whitepapers and more!
	Ability to take an active role in the discussions that are shaping the HPC technology discipline!
	Special offers available only to HPCwire members!

Become a Registered User Today!

Registered Users Log in Here to Comment

Email Address:	Password (case sensitive)

Remember me	Forgot Password?

Michael Feldman

Michael Feldman is the editor of HPCwire.

More Michael Feldman

Feature Articles

The Week in Review

C-DAC announces plans for a petaflop system; IBM researchers are working on vertical integration techniques to extend Moore's Law another 15 years. We recap those stories and more in our weekly wrapup.
Read More...

Moscow State University Supercomputer Has Petaflop Aspirations

The Moscow State University supercomputer, Lomonosov, has been selected for a high-performance makeover, with the goal of tripling its processing power to achieve petaflop-level performance in 2010. T-Platforms, who developed and manufactured the supercomputer, is the odds-on favorite to lead the project.
Read More...

Intel Ups Performance Ante with Westmere Server Chips

Right on schedule, Intel has launched its Xeon 5600 processors, codenamed "Westmere EP." The 5600 represents the 32nm sequel to the Xeon 5500 (Nehalem EP) for dual-socket servers. Intel is touting better performance and energy efficiency, along with new security features, as the big selling points of the new Xeons.
Read More...

Read more HPCwire features...

Top Headlines

Australia Commissions Cray Supercomputer

Mar 19 | OfficialWire | New super to support intelligence work Down Under. Read more...

Intel Partners See 'Easy' Upgrade Path With Xeon 5600 Chips

Mar 18 | ChannelWeb | Westmere parts already showing up in HPC machines. Read more...

AMD: OEMs primed for Opteron 6100s

Mar 17 | The Register | But what about the tier ones? Read more...

Arrival of the Desktop Supercomputer

Mar 17 | Cadalyst Magazine | A new generation of workstations is changing the nature of technical computing. Read more...

Scheduling HPC In The Cloud

Mar 17 | Linux Magazine | Latest iteration of Sun Grid Engine able to tap into Cloud. Read more...

Read more headlines...

Featured Whitepapers

Virtualization for Aggregation And The vSMP Architecture™

Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.

Copper Cable Technologies for High Performance Computing

Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.

View the White Paper Library

Multimedia

Webcast: Virtualized Data Center Roundtable

Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.

Webcast: Watch SC09 Birds of a Feather Video: Scalable Fault-Tolerant HPC Supercomputers

Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.

Webcast: High Performance Computing for a Smarter Planet

LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html