Zettar Unveils Data Movement Appliance at SC23 in Partnership with AIC and Intel

November 14, 2023

PALO ALTO, Calif., Nov. 14, 2023 – Zettar and AIC have announced that they will demonstrate a data movement appliance at Supercomputing 2023 (SC23), November 12 – 17, 2023, in collaboration with Intel. This is the world’s first showcase of such an appliance using IPUs with the built-in ability to offload a large variety of data movements – users no longer need to use multiple applications for different data movement scenarios.

The appliance supports both bulk and streaming data transfer, locally (within a host or a cluster) and over any distance. The design uses regular processors initially. Once such IPUs become generally available in early 2024, it is anticipated that such appliances can offload data movements to IPUs but still provide up to Tbps data rates.

The high-speed streaming capability enables the fast emerging real-time decision-making need for data-intensive endeavors. For example, whether the samples for Cryo-EM microscopes are properly prepared quickly, instead of waiting for 2-3 days. The Intel/Zettar appliance reference design has been operational since Q3 2023 on a testbed in Intel’s UK lab. The design is available to any Intel server vendor partners.

The design is timely. In 2016, the amount of data in the world entered the hockey stick phase. In recent years, two major IT trends have emerged: the edge to core/cloud paradigm and disaggregated infrastructure. In 2022, Generative AI and large language models were also introduced. The trio has created a “perfect storm” that has made it impossible to ignore the importance of moving data at scale and speed. Due to the massive amounts of data involved, nowadays, the Healthcare and Life Sciences (HLS) vertical must use HPC. Both need to use AI-based approaches. There is more and more need to make real-time decisions too. Current solutions in the market are incapable of dealing with this new reality. The Zettar data movement appliance enables “plug and play.” It also addresses three foremost data movement challenges once and for all:

  1. The need for site-specific H/W and S/W tuning
  2. The distance (aka network latency) impact
  3. Data exchange with collaborators

The reference design testbed incorporates four Intel IPUs. The unified software data mover Zettar zx is used to aggregate them into two collaborative dual-node clusters.

The left side is the topology of the Intel/Zettar data movement reference design testbed. On the right-hand side. The top shows bulk transfer sweep results. From 1MiB to 1TiB, the transfer rate is basically at the line rate (100 Gbps). The lower half shows streaming data rates, The same story.

This forward-looking design addresses the pressing need to minimize space usage, complexity, and cost – both acquisition and operational. It is rich in Environmental, Societal, and governance (ESG) benefits. Furthermore, it often helps avoid tedious and costly forklift upgrades.

This project leverages resources from both Intel’s UK lab and AIC Inc.’s lab in California. Specifically, in the Intel UK lab, Two Intel M50CYP2UR208 Server Systems; 1 x Intel E810-CQDA2 100G NIC; 8 x Intel DC P5800X 800G Optane SSDs aggregated using Linux software RAID as a RAID 0 array. Four C5010X IPUs made by Silicom based on the Intel C5000X-PL IPU design. AIC Inc. has furnished an SB201-HK, with 4 x Micron 9400 MAX 6.4TB NVMe SSDs, and an Intel F2000X-PL IPU. The unit is available in the AIC SC23 booth for review.

A recorded talk is provided in both AIC’s SC23 booth 2037 and Intel’s SC23 booth 617. The talk includes a live demo.

“Data tsunami is engulfing all verticals these days. Health data alone accounts for over 30% of the world’s data (Intel, 2022). CryoEM and photon-counting CT, two types of modern high-speed biomedical instruments, generate 20-60 TB/day per run. The appliance can not only move this data from the edge, where the instruments are located, to the core and/or cloud for further analysis with AI-powered pipelines but also make real-time data transport practical for real-time decision-making. It also simplifies and streamlines the workflow. Faster data movement can accelerate medical and scientific breakthroughs, improving the quality of life for all.” according to Chin Fang, Founder and CEO, of Zettar Inc.

“Datacenters have traditionally been monotonous in terms of computer architecture, consolidating resources in a single unit and sharing them through interconnection networks. However, the cost of delivering resources to gigantic data sets is becoming increasingly high. Heterogeneous computing and datacenter resource disaggregation will become new ways to leverage different processing capabilities to meet different computing demands.

IPUs/DPUs reflect the idea of offloading specialized tasks, such as NVEe storage acceleration, RDMA, encryption, compression, data deduplication, and even future CXL-based resources with either cache coherence or non-cache coherence. This can eliminate the performance penalty of data movement.

“Zettar provides a unified and efficient large data movement solution that will be an essential tool for dealing with IPU/DPU-enabled datacenter infrastructure,” said CT Sun, CTO and Vice President of Engineering of AIC Inc.

About Zettar

Zettar’s data mover software has earned a global, peerless reputation in the high-end HPC space for being the simplest, most efficient, and most versatile unified software data mover for moving data at scale, and at the speed of light. It is the world’s only commercial software whose design and capability have been motivated by Linac Coherent Light Source II, a premier U.S. DOE Exascale Computing preparation project. For more information, contact [email protected].

About AIC Inc.

AIC is a leading provider of both OEM/ODM and COTS (commercial off-the-shelf) and server and storage solutions. With expert in-house design, manufacturing, and validation capabilities, AIC’s products are highly flexible and configurable to any form factor, standard or custom. AIC has led the industry since 1996 with experience in mechanical, electronic, and system-level engineering as well as a dedication to innovation and customer satisfaction. Headquartered in Taiwan, AIC has offices and operations throughout the United States, Asia, and Europe.


Source: Zettar Inc.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

U.S. Quantum Director Charles Tahan Calls for NQIA Reauthorization Now

February 29, 2024

(February 29, 2024) Origin stories make the best superhero movies. I am no superhero, but I still remember what my undergraduate thesis advisor said when I told him that I wanted to design quantum computers in graduate s Read more…

pNFS Provides Performance and New Possibilities

February 29, 2024

At the cusp of a new era in technology, enterprise IT stands on the brink of the most profound transformation since the Internet's inception. This seismic shift is propelled by the advent of artificial intelligence (AI), Read more…

Celebrating 35 Years of HPCwire by Recognizing 35 HPC Trailblazers

February 29, 2024

In 1988, a new IEEE conference debuted in Orlando, Florida. The planners were expecting 200-300 attendees because the conference was focused on an obscure topic called supercomputing, but when it was announced that S Read more…

Forrester’s State of AI Report Suggests a Wave of Disruption Is Coming

February 28, 2024

The explosive growth of generative artificial intelligence (GenAI) heralds opportunity and disruption across industries. It is transforming how we interact with technology itself. During this early phase of GenAI technol Read more…

Q-Roundup: Google on Optimizing Circuits; St. Jude Uses GenAI; Hunting Majorana; Global Movers

February 27, 2024

Last week, a Google-led team reported developing a new tool - AlphaTensor Quantum - based on deep reinforcement learning (DRL) to better optimize circuits. A week earlier a team working with St. Jude Children’s Hospita Read more…

AWS Solution Channel

Shutterstock 2283618597

Deep-dive into Ansys Fluent performance on Ansys Gateway powered by AWS

Today, we’re going to deep-dive into the performance and associated cost of running computational fluid dynamics (CFD) simulations on AWS using Ansys Fluent through the Ansys Gateway powered by AWS (or just “Ansys Gateway” for the rest of this post). Read more…

Argonne Aurora Walk About Video

February 27, 2024

In November 2023, Aurora was ranked #2 on the Top 500 list. That ranking was with half of Aurora running the HPL benchmark. It seems after much delay, 2024 will finally be Aurora's time in the spotlight. For those cur Read more…

Royalty-free stock illustration ID: 1988202119

pNFS Provides Performance and New Possibilities

February 29, 2024

At the cusp of a new era in technology, enterprise IT stands on the brink of the most profound transformation since the Internet's inception. This seismic shift Read more…

Celebrating 35 Years of HPCwire by Recognizing 35 HPC Trailblazers

February 29, 2024

In 1988, a new IEEE conference debuted in Orlando, Florida. The planners were expecting 200-300 attendees because the conference was focused on an obscure t Read more…

Forrester’s State of AI Report Suggests a Wave of Disruption Is Coming

February 28, 2024

The explosive growth of generative artificial intelligence (GenAI) heralds opportunity and disruption across industries. It is transforming how we interact with Read more…

Q-Roundup: Google on Optimizing Circuits; St. Jude Uses GenAI; Hunting Majorana; Global Movers

February 27, 2024

Last week, a Google-led team reported developing a new tool - AlphaTensor Quantum - based on deep reinforcement learning (DRL) to better optimize circuits. A we Read more…

South African Cluster Competition Team Enjoys Big Texas HPC Adventure

February 26, 2024

Texas A&M University's High-Performance Research Computing (HPRC) hosted an elite South African delegation on February 8 - undergraduate computer science (a Read more…

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket fo Read more…

Apple Rolls out Post Quantum Security for iOS

February 21, 2024

Think implementing so-called Post Quantum Cryptography (PQC) isn't important because quantum computers able to decrypt current RSA codes don’t yet exist? Not Read more…

QED-C Issues New Quantum Benchmarking Paper

February 20, 2024

The Quantum Economic Development Consortium last week released a new paper on benchmarking – Quantum Algorithm Exploration using Application-Oriented Performa Read more…

Training of 1-Trillion Parameter Scientific AI Begins

November 13, 2023

A US national lab has started training a massive AI brain that could ultimately become the must-have computing resource for scientific researchers. Argonne N Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia Wins SC23, But Gets Socked by Microsoft’s AI Chip

November 16, 2023

Nvidia was invisible with a very small booth and limited floor presence, but thanks to its sheer AI dominance, it was a winner at the Supercomputing 2023. Nv Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Analyst Panel Says Take the Quantum Computing Plunge Now…

November 27, 2023

Should you start exploring quantum computing? Yes, said a panel of analysts convened at Tabor Communications HPC and AI on Wall Street conference earlier this y Read more…

Royalty-free stock illustration ID: 1675260034

RISC-V Summit: Ghosts of x86 and ARM Linger

November 12, 2023

Editor note: See SC23 RISC-V events at the end of the article At this year's RISC-V Summit, the unofficial motto was "drain the swamp," that is, x86 and Read more…

China Deploys Massive RISC-V Server in Commercial Cloud

November 8, 2023

If the U.S. government intends to curb China's adoption of emerging RISC-V architecture to develop homegrown chips, it may be getting late. Last month, China Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Leading Solution Providers

Contributors

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Chinese Company Developing 64-core RISC-V Chip with Tech from U.S.

November 13, 2023

Chinese chip maker SophGo is developing a RISC-V chip based on designs from the U.S. company SiFive, which highlights challenges the U.S. government may face in Read more…

Royalty-free stock illustration ID: 1182444949

Forget Zettascale, Trouble is Brewing in Scaling Exascale Supercomputers

November 14, 2023

In 2021, Intel famously declared its goal to get to zettascale supercomputing by 2027, or scaling today's Exascale computers by 1,000 times. Moving forward t Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire