PALO ALTO, Calif., Nov. 14, 2022 — Zettar has announced it will demonstrate the use of the NVIDIA BlueField DPU for data migration at Supercomputing 2022 (November 13 – 18, 2022). In collaboration with NVIDIA, this is the world’s first showcase to endow DPU built-in ability to offload a large variety of data movements, which are collectively a major data processing category.
There are two major IT trends happening in the industry: edge-to-core/cloud paradigm, and composable and disaggregated infrastructure. For both of these trends, data source and target are often far apart, and transporting data becomes mandatory. Owing to the rapid growth of massive amounts of modern data, efficient data movement is critical. The BlueField DPU is a key piece of NVIDIA networking solutions. When the BlueField DPU is coupled with NVIDIA Quantum InfiniBand networking and storage solutions from its rich ecosystem, it enables distributed data-intensive endeavors to gain significant productivity boosts and accelerate data to insight.
Furthermore, there is a pressing need to reduce computing-related energy and space consumption and obtain as much ROI as possible from existing IT infrastructure investments. DPUs help meet all such requirements. Furthermore, it often helps avoid tedious and costly forklift upgrades. The fact that Zettar zx is a widely recognized category-leading unified data mover enables the DPU to have comprehensive data movement coverage. Both bulk transfer and near-real-time streaming can be tackled efficiently. Users no longer need to use multiple applications for different data movement scenarios.
This project leverages the resources of the HPC-AI Advisory Council Cluster Center. Specifically, it uses a Dell PowerEdge R720 equipped with an NVIDIA BlueField-2 DPU, together with a Colfax CX2265i server. The DPU acts as the NVMe-oF initiator. The CX2265i acts as the NVMe-oF target.
The setup simulates typical file system data migration, often considered a very tedious but mandatory IT task. The talk includes a live demo.
Zettar CEO Chin Fang commented: “Almost all verticals are facing a data tsunami these days. For example, health data makes up more than 30% of the world’s data (Intel, 2022). Modern high-speed biomedical instruments such as CryoEM and photon-counting CT generate 20-60 TB/day per run for each instrument. Now it’s even more urgent to move data from the edge, where the instruments are located, to the core and/or cloud to be further analyzed, in the often AI-powered pipeline. Near-real-time data transport is becoming desirable. A DPU with built-in data movement abilities brings much simplicity and efficiency into the workflow. Faster data movement can lead to faster medical and scientific breakthroughs, improving the quality of life for all.”
About Zettar
Zettar‘s data mover software has earned a global, peerless reputation in the high-end HPC space for being the simplest, most efficient, and most versatile data manager for moving data at scale, at speed of light.
Source: Zettar