Even Better than a ‘Supercomputer-in-a-Box’

By Gary Keen, Engineer, Silicon Mechanics

March 15, 2021

Before we get started, can everyone reading this article agree that large compute clusters, supercomputers, HPC systems, or whatever else we choose to call them, are complex? Ok, good! Because, while “out of the box” solutions make things somewhat easier, it’s an oversimplification to say that’s all you need – and you end up missing a few key points about the value of complexity to the end user and their organization.

Many, many individual pieces need to work together to create a cluster and all of them can have a huge impact on the system’s overall performance. From a system architects’ perspective, each component is a decision that must be made, a choice that either improves your performance for a particular workload or hurts it. These decisions can weigh heavy on architects, but often weigh even heavier on the IT infrastructure managers responsible for their company’s budget and resources.

Bad choices in system design have a huge impact to a client organization’s capabilities and, ultimately, revenue. The problem is that it’s hard to know what to tell the system architect about which choices you prefer.  Yes, you could design the system yourself, but who has time to bone up on all the issues you need to consider and learn all the technologies out there that might work? Every choice could be a mistake – and your team could suffer for it for years.

From that point-of-view, it’s easy to see why the ‘supercomputer-in-a-box’ idea is appealing to most people on some level. A major technology provider with tons of experience, resources, and engineering brainpower figures out the best possible system for HPC, AI, or data analytics and you buy it.

Maybe it won’t be perfectly tuned to your workload, but at least you know what you can expect, and you don’t have to worry over the little decisions. It’s comfortable, predictable, and relatively safe. It’s also expensive, restrictive, and commonplace. Commonplace is important because, if everyone buys the same solution, no one has a competitive advantage. And who doesn’t want a competitive advantage?

Instead, you could get the best of both worlds by working with a solution provider with experience in both the latest technology but also a solid foundation in proven platforms and have this person design something unique to your needs.

The result is that you get a one-of-a-kind solution tuned to your workload that also stretches your budget further than the preconfigured solution could. What’s even better is that, today, that knowledgeable system architect you’ve hired will be aware of how you can take advantage of the best parts of the preconfigured solution.

Specifically, your system architect can give you the predictability, the simplicity, and the safety of that pre-configured supercomputer-in-a-box you keep seeing advertised everywhere and combine them with the best elements of a custom solution, namely lower costs, fine-tuned performance, and competitive advantage.

How? Building blocks.

Let me explain. System designers at reputable firms will have access to all the individual pieces that make up these pre-configured solutions. For instance, my team builds custom AI solutions based on the NVIDIA HGXTM server platform, which features the A100 GPU. When optimized to a specific workload, these custom solutions provide unmatched performance, and they can be tailored to be easy to use, seamlessly scalable, and more. Out-of-the-box solutions can’t give you that.

Generally, no two solutions are alike. This is great for customers that either need a unique solution for a unique problem or don’t have the budget for a pre-configured solution large enough to meet their needs.  These customers are willing to introduce variables to their system design in order to reach their goals. Not everyone is like that, and rightfully so, which is where the out-of-box options are most valuable.

Architects like our team at Silicon Mechanics want to reduce the number of variables in system designs to lower the perceived risk for our customers. We believe that building a strong solution for any workload requires balance between network, storage, and compute. So, we’re developing network, storage, and compute building blocks that are each unique, tested, and high-performance, but have their own, specific purpose in a larger system design.

Take storage for instance. A common trend nowadays is the faster the better, but that is only somewhat true. Not all workloads take advantage of that speed to the fullest, so using the fastest NVMe drives available, or even persistent memory devices, may be an unnecessary expense for you. Instead, we configure building blocks for slower flash storage or even *gasp* spinning disks.

We often suggest a tiered storage structure, which combines varying levels of high-bandwidth and high-capacity storage to provide top-tier performance at a better price. A pre-configured solution may only have the fastest, most expensive storage option available. The decision is no longer which drives to use or what form factor of a storage server to choose, but instead what performance level of storage does your workload need, and how much data will you have.

With the building blocks approach, the key is staying flexible. By configuring and testing building blocks at the storage, compute, or networking level, we gain some of the predictability of a pre-configured solution but can still tune the overall system to match your specific goals. This means as a customer, you can start small, investing only in what you need now, because you can always expand that system later. This is like the concept of rightsizing a cluster, you don’t always need a system to rank high on the Top500 list, you just need it to work for your team.

If you have a fully custom solution, it may be difficult to scale that design. Whereas a pre-configured solution may mean you have to start from scratch with the new version, or even worse, you are paying a premium for an old design that is no longer competitive with the market.

So as a solution designer who loves building unique solutions from the ground up and tinkering with components to get the most out of a solution, even I can endorse going with the middle ground. There are still great reasons to go with a fully custom solution and we are happy to build that with you. Similarly, the pre-configured solutions may be right for you and can absolutely be successful. It’s about finding a partner that you trust, knowing your options, leveraging your budget, and finding the solution that’s right for your team.

Right now, the Silicon Mechanics team is using this building blocks approach to design scalable, world-class AI and HPC solutions that feature the latest and greatest GPU architectures from NVIDIA. You can think of it as supercomputer performance without a supercomputer footprint.  If that interests you, I suggest checking out NVIDIA’s GPU Technology Conference (GTC) where our team will be giving several presentations about how to use building block technology and other best practices for industry-specific solutions.

To learn more about how Silicon Mechanics’ approach to system design, visit www.siliconmechanics.com

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket for an optional 8087 math coprocessor. The math coprocessor ma Read more…

IonQ Reports Advance on Path to Networked Quantum Computing

February 22, 2024

IonQ reported reaching a milestone in its efforts to use entangled photon-ion connectivity to scale its quantum computers. IonQ’s quantum computers are based on trapped ions which feature long coherence times and qubit Read more…

Apple Rolls out Post Quantum Security for iOS

February 21, 2024

Think implementing so-called Post Quantum Cryptography (PQC) isn't important because quantum computers able to decrypt current RSA codes don’t yet exist? Not Apple. Today the consumer electronics giant started rolling Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to derive any substantial value from it. However, the GenAI hyp Read more…

QED-C Issues New Quantum Benchmarking Paper

February 20, 2024

The Quantum Economic Development Consortium last week released a new paper on benchmarking – Quantum Algorithm Exploration using Application-Oriented Performance Benchmarks – that builds on earlier work and is an eff Read more…

AWS Solution Channel

Shutterstock 2283618597

Deep-dive into Ansys Fluent performance on Ansys Gateway powered by AWS

Today, we’re going to deep-dive into the performance and associated cost of running computational fluid dynamics (CFD) simulations on AWS using Ansys Fluent through the Ansys Gateway powered by AWS (or just “Ansys Gateway” for the rest of this post). Read more…

Atom Computing Reports Advance in Scaling Up Neutral Atom Qubit Arrays

February 15, 2024

The scale-up challenge facing quantum computing (QC) is daunting and varied. It’s commonly held that 1 million qubits (or more) will be needed to deliver practical fault tolerant QC. It’s also a varied challenge beca Read more…

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket fo Read more…

Apple Rolls out Post Quantum Security for iOS

February 21, 2024

Think implementing so-called Post Quantum Cryptography (PQC) isn't important because quantum computers able to decrypt current RSA codes don’t yet exist? Not Read more…

QED-C Issues New Quantum Benchmarking Paper

February 20, 2024

The Quantum Economic Development Consortium last week released a new paper on benchmarking – Quantum Algorithm Exploration using Application-Oriented Performa Read more…

The Pulse of HPC: Tracking 4.5 Million Heartbeats of 3D Coronary Flow

February 15, 2024

Working in Duke University's Randles Lab, Cyrus Tanade, a National Science Foundation graduate student fellow and Ph.D. candidate in biomedical engineering, is Read more…

It Doesn’t Get Much SWEETER: The Winter HPC Computing Festival in Corpus Christi

February 14, 2024

(Main Photo by Visit Corpus Christi CrowdRiff) Texas A&M University's High-Performance Research Computing (HPRC) team hosted the "SWEETER Winter Comput Read more…

Q-Roundup: Diraq’s War Chest, DARPA’s Bet on Topological Qubits, Citi/Classiq Explore Optimization, WEF’s Quantum Blueprint

February 13, 2024

Yesterday, Australian start-up Diraq added $15 million to its war chest (now $120 million) to build a fault tolerant computer based on quantum dots. Last week D Read more…

2024 Winter Classic: Razor Thin Margins in HPL/HPCG

February 12, 2024

The first task for the 11 teams in the 2024 Winter Classic student cluster competition was to run and optimize the LINPACK and HPCG benchmarks. As usual, the Read more…

2024 Winter Classic: We’re Back!

February 9, 2024

The fourth edition of the Winter Classic Invitational Student Cluster Competition is up and running. This year, we have 11 teams of eager students representin Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire