Dell Brings GPUs from Intel and Nvidia to New Servers

By Agam Shah

January 17, 2023

Dell’s enterprise computing playbook has diversified in the last year, with new additions like quantum computing and high-performance computing-as-a-service to its portfolio.

The company on Tuesday announced what it characterized as a major expansion of its server portfolio. The updates include multi-socket servers that fit into the deep learning and datacenter infrastructures, and also systems targeted at cloud providers.

“We’re refreshing the core portfolio with the latest and greatest technology,” said Rajesh Pohani, vice president of PowerEdge, high-performance computing, and core compute technologies at Dell.

Dell PowerEdge R760

The new lineup of PowerEdge servers is a step up from the previous generation, and includes Intel’s new fourth-gen Xeon chips codenamed Sapphire Rapids, and AMD’s Epyc chips called Genoa, both of which were launched in recent months. The new servers also support Nvidia’s new GPUs codenamed Hopper.

The overall upgrades provide a major performance boost with storage and memory technologies that include DDR5 memory and PCI Express 5.0, which are supported by Sapphire Rapids and Genoa.

Customer needs are getting more specific with applications such as AI, and high-performance systems in datacenters are trying to make sense of telemetry and other data coming in from servers and devices on the edge, Pohani said.

The AI-focused high-performance systems include the PowerEdge XE9680, which can pair eight Nvidia H100 GPUs with support for the SXM5 connector and the NVLink interconnect. The 6U server has Sapphire Rapids CPUs and 10 PCIe Gen5 slots. The 4U PowerEdge XE8640 can support up to four H100 GPUs with SXM5 and NvLink support, and is paired along with Sapphire Rapids CPUs. Both are air-cooled systems.

Another new server, the 2U PowerEdge XE9640 server supports up to four of Intel’s Max series GPUs, codenamed Ponte Vecchio. The four-way GPU system supports Sapphire Rapids chips, and can also be configured with Nvidia’s Hopper GPUs, which will come with an AI Enterprise license so customers can write AI applications based on the CUDA parallel programming framework.

Dell also upgraded the mainstream server offerings, which include the R960, R860, R760, the R660 and the R760xa. The R660 offers up to 104% faster compute performance than the previous generation R650, while the R860 delivers 184% better performance in the past generation, Pohani said.

The new chips and support for faster interconnects also played a role in boosting server performance.

“The new RAID controller that we’re introducing gets you 2x the performance of the previous generation,” Pohani said.

Dell’s updated PowerEdge portfolio. Source: Dell

Pohani declined to say whether the new servers with Sapphire Rapids will support Intel’s on-demand feature, which allows turning on chip capabilities for a fee.

Intel most likely has not sorted out how it will implement on-demand through traditional server makers like Dell or HPE, said Jim McGregor, principal analyst at Tirias Research.

“For the most part, Intel is probably just going to be selling [Sapphire Rapids] with everything enabled, because on-demand would be a whole new business model for them,” McGregor said.

Dell servers will be offered through the company’s APEX (computing-as-a) service, or as bare-metal deployments either on-premises or via colocation providers.

Dell is getting more active in commercial HPC with business workloads tilting to AI and ML training, and the new systems fit into Dell’s move up the computing ladder into HPC, said Charles King, principal analyst at research firm Pund-IT.

“An interesting thing about Dell APEX in regards to HPC is how a ‘pay as you go’ model could benefit businesses considering AI and similar solutions,” King said.

The other servers introduced by Dell include the PowerEdge HS5620 and HS5610 servers, which are targeted at hyperscalars.

“The HS line is a new part of our portfolio expansion to meet the requirements of cloud service providers,” Pohani said.

The Dell PowerEdge R760 servers will be globally available next month and the PowerEdge HS5620, HS5610 are slated to be widely available in April. Other  Availability for other servers and APEX services will come later in the year.

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Intel’s Silicon Brain System a Blueprint for Future AI Computing Architectures

April 24, 2024

Intel is releasing a whole arsenal of AI chips and systems hoping something will stick in the market. Its latest entry is a neuromorphic system called Hala Point. The system includes Intel's research chip called Loihi 2, Read more…

Anders Dam Jensen on HPC Sovereignty, Sustainability, and JU Progress

April 23, 2024

The recent 2024 EuroHPC Summit meeting took place in Antwerp, with attendance substantially up since 2023 to 750 participants. HPCwire asked Intersect360 Research senior analyst Steve Conway, who closely tracks HPC, AI, Read more…

AI Saves the Planet this Earth Day

April 22, 2024

Earth Day was originally conceived as a day of reflection. Our planet’s life-sustaining properties are unlike any other celestial body that we’ve observed, and this day of contemplation is meant to provide all of us Read more…

Intel Announces Hala Point – World’s Largest Neuromorphic System for Sustainable AI

April 22, 2024

As we find ourselves on the brink of a technological revolution, the need for efficient and sustainable computing solutions has never been more critical.  A computer system that can mimic the way humans process and s Read more…

Empowering High-Performance Computing for Artificial Intelligence

April 19, 2024

Artificial intelligence (AI) presents some of the most challenging demands in information technology, especially concerning computing power and data movement. As a result of these challenges, high-performance computing Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that have occurred about once a decade. With this in mind, the ISC Read more…

Intel’s Silicon Brain System a Blueprint for Future AI Computing Architectures

April 24, 2024

Intel is releasing a whole arsenal of AI chips and systems hoping something will stick in the market. Its latest entry is a neuromorphic system called Hala Poin Read more…

Anders Dam Jensen on HPC Sovereignty, Sustainability, and JU Progress

April 23, 2024

The recent 2024 EuroHPC Summit meeting took place in Antwerp, with attendance substantially up since 2023 to 750 participants. HPCwire asked Intersect360 Resear Read more…

AI Saves the Planet this Earth Day

April 22, 2024

Earth Day was originally conceived as a day of reflection. Our planet’s life-sustaining properties are unlike any other celestial body that we’ve observed, Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that ha Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use o Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pre Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

Intel’s Xeon General Manager Talks about Server Chips 

January 2, 2024

Intel is talking data-center growth and is done digging graves for its dead enterprise products, including GPUs, storage, and networking products, which fell to Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire