Researchers Challenge NAND Flash with Phase Change Memory

By Michael Feldman

June 6, 2011

A team of researchers at the University of California, San Diego (UCSD) has built a solid state storage system that they claim outperforms state-of-the-art flash memory products. The new system, know as Moneta, uses phase change memory, a technology that some predict will replace the NAND flash memory used in nearly every solid state drive (SSD) today. The UCSD prototype will be on display this week at the Design Automation Conference in San Diego.

Moneta, which is the Latin name for the goddess of memory, uses phase change memory (PCM) module from Micron Technology as the storage medium and employs Xilinx FPGAs as memory controllers. The system DIMM, referred to as Onyx, is a 640 MB device made up of 40 of Micron’s 16 MB PCM (P8P) chips.* The entire system houses 16 of these DIMMs, yielding 10 GB of raw storage: 8 GB usable and 2 GB for error correction and metadata. The card connects to a Linux host via a PCIe x8 link. The prototype and its performance characteristics are described in detail here.

Like NAND flash memory, phase change memory is non-volatile, but it’s a total different digital animal. PCM is based on a metal alloy called chalcogenide and works, as its name suggests, by changing the state of the alloy. To write data, electrical current is applied to generate heat, which switches the alloy between its crystalline and its amorphous state. To read the data back, a smaller current is applied to determine which state the alloy is in.

PCM has several significant advantages over NAND. To begin with, it is inherently more robust than NAND, having an average endurance of 100,000,000 write cycles as compared to 100,000 for enterprise-class SLC NAND. That means the wear leveling algorithm can be much simpler, resulting in less software and memory overhead. PCM is also byte addressable, which means it is much more efficient than NAND at accessing smaller chunks of data, again reducing system complexity. Finally, PCM is just faster. The bits can be switched quickly, and can be flipped in place, avoiding the laborious block erase-and-write cycle required by NAND.

A longer term advantage cited for PCM is that it will scale better than NAND (or even DRAM) as process geometries shrink below 20nm. This has yet to be proven, but it has certainly encouraged companies like Micron and Intel to invest heavily in the technology.

The PCM hardware is only half of the Moneta story though. The system’s real value is contained in the software, which has been tuned for the higher performing PCM. Specifically, they developed a low-level block driver for Moneta that bypasses the Linux I/O scheduler, such that throughput and latency are optimized.

“We’ve found that you can build a much faster storage device, but in order to really make use of it, you have to change the software that manages it as well. Storage systems have evolved over the last 40 years to cater to disks, and disks are very, very slow,” said Steven Swanson, professor of Computer Science and Engineering at UCSD and director of its Non-Volatile Systems Lab (NVSL). “Designing storage systems that can fully leverage technologies like PCM requires rethinking almost every aspect of how a computer system’s software manages and accesses storage. Moneta gives us a window into the future of what computer storage systems are going to look like, and gives us the opportunity now to rethink how we design computer systems in response.”

To prove the technology’s worth, the UCSD team compared Moneta to a well known NAND flash product, in this case, an 80GB Fusion-io ioDrive. However, being a first-generation prototype, the results are somewhat of a mixed bag.

For 512-byte block accesses, Moneta can read data at 327 MB/sec and write at 91 MB/sec; which is between two and seven times faster than the Fusion-io ioDrive. For large data blocks (32K and up), Moneta can read data at 1.1 GB/sec and write data at 371 MB/sec. Here the PCM system is still outrunning the ioDrive for reads, but is actually somewhat slower in writes. The researchers attribute this to the ioDrive’s better aggregate bandwidth associated with its larger memory capacity, all of which is optimized for large block sizes.

Keep in mind that Fusion-io also offers PCIe flash devices with much more capacity and associated bandwidth than the version the UCSD researchers benchmarked. For example, Fusion-io claims 1.5 GB/sec in both reads and writes for its 320 GB ioDrive Duo with 64K block sizes, and 6.0 GB/sec in reads and 4.4 GB/sec in writes for its giant 5TB ioDrive Octal. Obviously size matters.

Other NAND SSD vendors are pushing the capacity/bandwidth envelop as well. Micron’s 700GB P320h flash drive delivers 3 GB/sec for reading and 2 GB/sec for writing (128K blocks); the latest 900GB RamSan-70 card for Texas Memory Systems manages 2 GB/sec reads and 1.4 GB/sec writes; and Virident Systems’ 800GB tachIOn drive tops out at 1.44 GB/sec and 1.2 GB/sec for reads and writes, respectively.

Of course, I/O bandwidth is just a single criteria. Performance under various loads and conditions (like when a drive becomes full) is also important. Cost, latency, longevity, power consumption are other factors that need to be considered.

In the case of power consumption, the UCSD researchers point out that because of the less idiosyncratic behavior of PCM compared to NAND, the software driver is simpler, thus there is a reduction in CPU usage. The researchers say that their Moneta prototype spends between 20 and 50 percent less CPU time performing I/O operations for small requests. That frees up the CPU to do application work and reduces the overall power consumption of the storage system.

The bottom line is that if Moneta can be scaled up to larger memory capacities and aggregate bandwidth on a single PCIe device, its natural advantage in read performance, small (i.e., random) write performance, and endurance will give the NAND-based SSD makers something to think about. The UCSD researchers contend that a PCM-based storage system will be of particular value in applications like high-performance caching systems and key-value stores, that require high performance reads and small writes. For example, applications that do a lot of random I/O, like large graph computations, are especially suited to Moneta-type architectures.

The UCSD team plans to upgrade Moneta in the next six to nine months, using denser and higher performing PCM devices. No PCM roadmap from Micron or anyone else has been made public, but the researchers say that the Moneta technology could be commercially available in just a few years.

*The original version of this story erroneously reported the DIMM and P8P storage specifications in GB rather than MB. –Editor

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

At SC18: AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

Dell EMC’s HPC Chief on Strategy and Emerging Processor Diversity

November 16, 2018

Last January Thierry Pellegrino, a long-time Dell/Dell EMC veteran, became vice president of HPC. His tenure comes at a time when the very definition of HPC is blurring with AI writ large (data analytics, machine learnin Read more…

By John Russell

IBM’s AI-HPC Combine for ‘Intelligent Simulation’: Eliminating the Unnecessary 

November 16, 2018

A powerhouse concept in attaining new knowledge is the notion of the “emergent property,” the combination of formerly stovepiped scientific disciplines and exploratory methods to form cross-disciplinary intelligence Read more…

By Doug Black

HPE Extreme Performance Solutions

AI Can Be Scary. But Choosing the Wrong Partners Can Be Mortifying!

As you continue to dive deeper into AI, you will discover it is more than just deep learning. AI is an extremely complex set of machine learning, deep learning, reinforcement, and analytics algorithms with varying compute, storage, memory, and communications needs. Read more…

IBM Accelerated Insights

From Deep Blue to Summit – 30 Years of Supercomputing Innovation

This week, in honor of the 30th anniversary of the SC conference, we are highlighting some of the most significant IBM contributions to supercomputing over the past 30 years. Read more…

How the United States Invests in Supercomputing

November 14, 2018

The CORAL supercomputers Summit and Sierra are now the world's fastest computers and are already contributing to science with early applications. Ahead of SC18, Maciej Chojnowski with ICM at the University of Warsaw discussed the details of the CORAL project with Dr. Dimitri Kusnezov from the U.S. Department of Energy. Read more…

By Maciej Chojnowski

At SC18: AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

Dell EMC’s HPC Chief on Strategy and Emerging Processor Diversity

November 16, 2018

Last January Thierry Pellegrino, a long-time Dell/Dell EMC veteran, became vice president of HPC. His tenure comes at a time when the very definition of HPC is Read more…

By John Russell

IBM’s AI-HPC Combine for ‘Intelligent Simulation’: Eliminating the Unnecessary 

November 16, 2018

A powerhouse concept in attaining new knowledge is the notion of the “emergent property,” the combination of formerly stovepiped scientific disciplines and Read more…

By Doug Black

How the United States Invests in Supercomputing

November 14, 2018

The CORAL supercomputers Summit and Sierra are now the world's fastest computers and are already contributing to science with early applications. Ahead of SC18, Maciej Chojnowski with ICM at the University of Warsaw discussed the details of the CORAL project with Dr. Dimitri Kusnezov from the U.S. Department of Energy. Read more…

By Maciej Chojnowski

At SC18: Humanitarianism Amid Boom Times for HPC

November 14, 2018

At SC18 in Dallas, the feeling on the ground is one of forward-looking buoyancy. Like boom times that cycle through the Texas oil fields, the HPC industry is en Read more…

By Doug Black

Nvidia’s Jensen Huang Delivers Vision for the New HPC

November 14, 2018

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

New Panasas High Performance Storage Straddles Commercial-Traditional HPC

November 13, 2018

High performance storage vendor Panasas has launched a new version of its ActiveStor product line this morning featuring what the company said is the industry’s first plug-and-play, portable parallel file system that delivers up to 75 Gb/s per rack on industry standard hardware combined with “enterprise-grade reliability and manageability.” Read more…

By Doug Black

SC18 Student Cluster Competition – Revealing the Field

November 13, 2018

It’s November again and we’re almost ready for the kick-off of one of the greatest computer sports events in the world – the SC Student Cluster Competitio Read more…

By Dan Olds

Cray Unveils Shasta, Lands NERSC-9 Contract

October 30, 2018

Cray revealed today the details of its next-gen supercomputing architecture, Shasta, selected to be the next flagship system at NERSC. We've known of the code-name "Shasta" since the Argonne slice of the CORAL project was announced in 2015 and although the details of that plan have changed considerably, Cray didn't slow down its timeline for Shasta. Read more…

By Tiffany Trader

TACC Wins Next NSF-funded Major Supercomputer

July 30, 2018

The Texas Advanced Computing Center (TACC) has won the next NSF-funded big supercomputer beating out rivals including the National Center for Supercomputing Ap Read more…

By John Russell

IBM at Hot Chips: What’s Next for Power

August 23, 2018

With processor, memory and networking technologies all racing to fill in for an ailing Moore’s law, the era of the heterogeneous datacenter is well underway, Read more…

By Tiffany Trader

Requiem for a Phi: Knights Landing Discontinued

July 25, 2018

On Monday, Intel made public its end of life strategy for the Knights Landing "KNL" Phi product set. The announcement makes official what has already been wide Read more…

By Tiffany Trader

House Passes $1.275B National Quantum Initiative

September 17, 2018

Last Thursday the U.S. House of Representatives passed the National Quantum Initiative Act (NQIA) intended to accelerate quantum computing research and developm Read more…

By John Russell

CERN Project Sees Orders-of-Magnitude Speedup with AI Approach

August 14, 2018

An award-winning effort at CERN has demonstrated potential to significantly change how the physics based modeling and simulation communities view machine learni Read more…

By Rob Farber

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

By John Russell

Leading Solution Providers

US Leads Supercomputing with #1, #2 Systems & Petascale Arm

November 12, 2018

The 31st Supercomputing Conference (SC) - commemorating 30 years since the first Supercomputing in 1988 - kicked off in Dallas yesterday, taking over the Kay Ba Read more…

By Tiffany Trader

At SC18: AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

TACC’s ‘Frontera’ Supercomputer Expands Horizon for Extreme-Scale Science

August 29, 2018

The National Science Foundation and the Texas Advanced Computing Center announced today that a new system, called Frontera, will overtake Stampede 2 as the fast Read more…

By Tiffany Trader

HPE No. 1, IBM Surges, in ‘Bucking Bronco’ High Performance Server Market

September 27, 2018

Riding healthy U.S. and global economies, strong demand for AI-capable hardware and other tailwind trends, the high performance computing server market jumped 28 percent in the second quarter 2018 to $3.7 billion, up from $2.9 billion for the same period last year, according to industry analyst firm Hyperion Research. Read more…

By Doug Black

Intel Announces Cooper Lake, Advances AI Strategy

August 9, 2018

Intel's chief datacenter exec Navin Shenoy kicked off the company's Data-Centric Innovation Summit Wednesday, the day-long program devoted to Intel's datacenter Read more…

By Tiffany Trader

Germany Celebrates Launch of Two Fastest Supercomputers

September 26, 2018

The new high-performance computer SuperMUC-NG at the Leibniz Supercomputing Center (LRZ) in Garching is the fastest computer in Germany and one of the fastest i Read more…

By Tiffany Trader

Houston to Field Massive, ‘Geophysically Configured’ Cloud Supercomputer

October 11, 2018

Based on some news stories out today, one might get the impression that the next system to crack number one on the Top500 would be an industrial oil and gas mon Read more…

By Tiffany Trader

Nvidia’s Jensen Huang Delivers Vision for the New HPC

November 14, 2018

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This