DataDirect Gears Up for Next Generation Storage Appliance

By Michael Feldman

December 14, 2007

Last month DataDirect Networks announced its 8th generation high performance storage offering, the S2A9900. The new system will double the 3 GB/second performance of the current S2A9550, reaching 6 GB per second per S2A9900 storage appliance. The new technology continues in the tradition of previous S2A systems in providing enterprise-class performance and reliability with inexpensive SATA disk hardware.

Like its predecessors, the S2A9900 architecture operates as a self-healing storage array that operates in real time. Unlike solutions with file system-based error management, the DataDirect philosophy is to let the I/O system localize error management at the level of the drive. Using RAID technologies, data integrity is managed below the application layer, which enables error detection/correction to be done on the fly and transparently to the user’s software.

“We developed a product that always presents the same consistent operation in reads and writes regardless of error conditions or any type of failure below the control system,” said Dave Fellinger, DataDirect’s chief technology officer. “That’s what sets us apart.”

Using one terabyte disks, a single S2A9900 appliance can drive up to 1.2 petabytes of storage, which can all fit in two racks (20 4U drive enclosures plus the 4U storage appliance). Besides doubling the storage bandwidth per appliance, DataDirect has also doubled the bandwidth available to a host compute node by adding support for 8 Gbps Fibre Channel and 20 Gbps (DDR) InfiniBand. This allows for a more consolidated switching fabric, reducing the number of adapter cards.

Besides performance, the biggest change to in the new technology is the ability to mix serial attached SCSI (SAS) drives and SATA drives behind the same S2A appliance. SAS disks spin twice as fast as SATA, but are lower capacity. The idea is to be able to mix enterprise-class, low latency SAS storage with less expensive, high capacity SATA storage.

In general, SATA drives make sense where price and capacity are the most important criteria, as they are in most HPC applications. A few HPC customers may choose the SAS drive to overcome some level of paranoia about using SATA, but DataDirect’s S2A technology was precisely designed to overcome reliability issues with the lower cost hardware. SAS makes most sense in areas outside of HPC, where non-sequential metadata access in the norm, such as in online video serving. In this case, the real-time nature of the user experience makes low latency SAS drives a natural fit. In some cases, HPC customers may prefer a certain amount of SAS capacity where non-sequential data access requires a level of latency that can’t be met with SATA hardware.

Prior to the S2A9900 generation, the backend technology was based on the Fibre Channel protocol, which supported SATA through a bridge chip that made the drives appear to be Fibre Channel devices. DataDirect felt the architecture would be better served with a SAS backend, since both SAS and SATA are based on a compatible serial, point-to-point interface. This makes it much easier to deal with SATA commands over SAS and allows both architectures to be easily accommodated in the same storage system, as has been done for the S2A9900.

Although each appliance can read and write 6 GB/second to the host, a lot more bandwidth is available internally thanks to more powerful processing hardware, a shift to the faster PCI express bus, and the use of the SATA-friendly backend. Each appliance can achieve 24 GB/second, compared to 4 GB/second with the current S2A9550. This will allow expanded capabilities to be developed via software, making features like mirroring and other data migration strategies possible. Since there’s so much bandwidth headroom available, these operations can be performed concurrently with application I/O, without compromising host-side performance.

Another new feature is a “sleep mode” that allows idle drives to spin down when not in use. The idle period is configurable so that users can select an appropriate amount of time for their own setup. With the growing focus on datacenter energy efficiency, there could be a lot of interest in this feature, especially for the kinds of applications that write data once, but only read that data at long intervals. DataDirect plans to introduce this capability in the S2A9550 and carry it into the S2A9900.

The S2A9900 also has the ability to cycle power on badly behaving drives, in attempt to get them back to a good state. According to Fellinger, occasionally the microcode in an otherwise sound drive loses its way, and the only way to reset it is with a power cycle. The idea is to avoid trashing good — if somewhat flaky — drives in order to minimize hardware replacements and data rebuilds. In installations that deal with classified data, a disk drive replacement is extremely inconvenient and is best avoided whenever possible. Taking a drive down for a minute or so while the power is cycled is not a problem for S2A technology, since the RAID implementation allows the storage system to operate at full speed with a missing drive. When the drive comes back online, the system restores the missing writes transparently.

“The whole point here is uptime without human intervention,” says Fellinger. “If you’re running an HPC center with tens of thousands of drives, that becomes a very, very important attribute.”

Although DataDirect won’t ship the S2A9900 until Q1 2008, the company has already announced that Argonne National Laboratory has purchased an 8 PB storage setup for their new Blue Gene/P system scheduled to be installed next year. The storage will be driven by 17 S2A9900 appliances and contain over 8000 1 TB SATA drives. Aggregated storage bandwidth is expected to reach 100 GB/second.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire