The Promise and Progress of NVM Express

By Tiffany Trader

October 29, 2015

The high-performance computing community has started to take notice of Non-Volatile Memory Express (NVMe) technology. This communications interface and protocol was developed for SSDs by NVM Express Inc., an industry consortium of more than 80 members, including Intel, Micron, Dell and Seagate. According to its backers, NVMe allows the parallelism levels offered by SSDs to be fully utilized by the host’s hardware and software. For HPC, NVMe promises unprecedented IOPS and low latency, speeding workflows.

Silicon Mechanics reports that NVMe provides almost 3 Gbps of read bandwidth and about 500K IOPs. The same source says that “compared to SATA SSDs, NVMe offers up to 6x the performance, half the latency and double the CPU efficiency.”

So what it is NVMe?

NVM Express is a scalable host controller interface designed from the ground up for non-volatile memory. The specification defines an optimized register interface, command set and feature set for PCIe storage devices to overcome the bottlenecks of older protocols and storage buses. Support also exists for enterprise capabilities, such as end-to-end data protection, enhanced error reporting, and virtualization.

Over at the Bright Computing blog, Drew Robb highlights the features that make NVMe a technology to consider for accelerated application performance.

In-memory architectures are recent innovations that provide the highest level of performance to applications harnessed for HPC. If cost were no object, everything would be done in-memory. In order to get around this, many implementers have been able to augment processing and memory with flash, either in the form of solid state drives (SSDs) or by placing the flash beside the processor using PCIe.

PCIe does provide more bandwidth and lower latency for HPC, and PCIe Gen 3 supports about 7.87 Gbps per lane. However, one of the major roadblocks to employing PCIe across platforms is that PCIe relies on aging SATA and SAS protocols developed for relatively sluggish hard drives. As a result, big queues can develop when too much compute is involved. Unfortunately, SATA allows for only one command queue that can hold up to 32 commands per queue. NVMe, on the other hand, enables 65,536 (64K) queues each with 64K commands per queue, enabling greater productivity in a smaller timeframe.

Additional information comes from Intel’s Dave Akerson. At a recent tutorial he gave on NVMe at the OFA Developers’ Workshop (slides), he answered an audience member’s question about the value of the technology for HPC.

“From a performance standpoint, you can actually replace 20 hard disk drives with one SATA SSD today and get equivalent performance. In the case of an NVM Express PCIe drive you basically can replace five of those SSDs with one PCI Express to get the performance,” he stated. “In terms of cost, SATA SSDs are a little more expensive as far as the acquisition cost on a cost per gigabyte basis, however you can probably do more with a lower volume of SSDs than what you can do with your hard disk drives today. So you’ve got some cost savings there. Now in terms of PCI Express SSDs versus SATA SSDs, yes today you are likely paying a slight premium for that additional performance. Over time, and probably within the next 2-3 years, you’re going to see PCI Express and SATA at roughly equivalent cost parity.”

Version 1.0 of the NVM Express specification was released on March 1, 2011. NVM Express, Inc., announced the release of its 1.2 specification on November 12, 2014, adding “a new level of enterprise and client functionality.” NVMe devices are shipping now from Samsung, Intel, Silicon Mechanics, HGST and others.

The consortium is also developing specifications to bring the benefits of NVM Express to fabrics such as Ethernet, InfiniBand and Fibre Channel. An NVM Express over Fabrics standard, expected at the end of 2015, will extend NVMe “to usages with hundreds of solid state drives where using a fabric as an attach point is more appropriate than using PCI Express.” Work is progressing very quickly; Mangstor and Micron, among others, are already demoing pre-production setups with Mellanox gear.

From the Mellanox blog:

As mentioned, Mangstor is back with an upgraded NVMe Over Fabrics solution. Their NX6320 flash storage array now supports Mellanox ConnectX-4 for 100Gb Ethernet and can do 14M (million) IOPs. It’s rumored another configuration using multiple Mangstor arrays can hit 50GB/s (yes, 50 GigaBytes per second) of throughput.

Micron has a demo of NVMe Over Fabrics supporting millions of IOPs with very low latency. It also uses Mellanox ConnectX-4 adapter running 56Gb. 

Mellanox’s conclusion?

Non-volatile memory (NVMEM) is getting faster. Instead of just replacing hard drives, it’s ready to displace DRAM by letting customers build servers with more NVMEM and less DRAM, increasing application performance while lowering costs.

We’ll be looking to catch up with all of these parties at SC next month so we can report back on their progress.

For the less technical or those brand new to NVMe, or if you’re looking for a handy reference for someone who meets that description, a good place to start is “NVMe for absolute beginners” by Cisco’s J Metz.

Are you using NVMe in an HPC or big data environment? Tell us what you think in the comments section or email me at [email protected].

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, code-named Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from its predecessors, including the red-hot H100 and A100 GPUs. Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. While Nvidia may not spring to mind when thinking of the quant Read more…

2024 Winter Classic: Meet the HPE Mentors

March 18, 2024

The latest installment of the 2024 Winter Classic Studio Update Show features our interview with the HPE mentor team who introduced our student teams to the joys (and potential sorrows) of the HPL (LINPACK) and accompany Read more…

Houston We Have a Solution: Addressing the HPC and Tech Talent Gap

March 15, 2024

Generations of Houstonian teachers, counselors, and parents have either worked in the aerospace industry or know people who do - the prospect of entering the field was normalized for boys in 1969 when the Apollo 11 missi Read more…

Apple Buys DarwinAI Deepening its AI Push According to Report

March 14, 2024

Apple has purchased Canadian AI startup DarwinAI according to a Bloomberg report today. Apparently the deal was done early this year but still hasn’t been publicly announced according to the report. Apple is preparing Read more…

Survey of Rapid Training Methods for Neural Networks

March 14, 2024

Artificial neural networks are computing systems with interconnected layers that process and learn from data. During training, neural networks utilize optimization algorithms to iteratively refine their parameters until Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, code-named Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Houston We Have a Solution: Addressing the HPC and Tech Talent Gap

March 15, 2024

Generations of Houstonian teachers, counselors, and parents have either worked in the aerospace industry or know people who do - the prospect of entering the fi Read more…

Survey of Rapid Training Methods for Neural Networks

March 14, 2024

Artificial neural networks are computing systems with interconnected layers that process and learn from data. During training, neural networks utilize optimizat Read more…

PASQAL Issues Roadmap to 10,000 Qubits in 2026 and Fault Tolerance in 2028

March 13, 2024

Paris-based PASQAL, a developer of neutral atom-based quantum computers, yesterday issued a roadmap for delivering systems with 10,000 physical qubits in 2026 a Read more…

India Is an AI Powerhouse Waiting to Happen, but Challenges Await

March 12, 2024

The Indian government is pushing full speed ahead to make the country an attractive technology base, especially in the hot fields of AI and semiconductors, but Read more…

Charles Tahan Exits National Quantum Coordination Office

March 12, 2024

(March 1, 2024) My first official day at the White House Office of Science and Technology Policy (OSTP) was June 15, 2020, during the depths of the COVID-19 loc Read more…

AI Bias In the Spotlight On International Women’s Day

March 11, 2024

What impact does AI bias have on women and girls? What can people do to increase female participation in the AI field? These are some of the questions the tech Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Analyst Panel Says Take the Quantum Computing Plunge Now…

November 27, 2023

Should you start exploring quantum computing? Yes, said a panel of analysts convened at Tabor Communications HPC and AI on Wall Street conference earlier this y Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Training of 1-Trillion Parameter Scientific AI Begins

November 13, 2023

A US national lab has started training a massive AI brain that could ultimately become the must-have computing resource for scientific researchers. Argonne N Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire