Enabling Highly-Scalable Commercial HPC

October 6, 2020

Why commercial HPC is different: A look at the storage requirements in commercial HPC settings

For years, government research labs and major academic computing centers have been the proving ground for all new high-performance computing (HPC) technology such as the latest CPU’s and GPU’s, high-performance networking and parallel file system storage. These organizations continually push the envelope with custom technology builds that allow them to run the most realistic models and simulations, and work with the largest datasets. Eventually, most of the HPC technology used in these labs makes its way into commercial HPC settings.

Unfortunately, businesses often encounter problems using these advanced technologies. The problems arise because the high-end labs and government centers have different priorities. When selecting technology, their main driver is performance at any cost, causing uptime, ease of management, and vendor support to fall far behind in consideration.

Why commercial HPC is different

While some commercial HPC compute requirements in fields like life sciences, energy exploration, manufacturing, finance, movie production, etc. are comparable to those in the large supercomputing centers and government labs, there are vast differences in systems requirements.

Commercial HPC cannot afford downtime, so reliability is paramount. Nor do these businesses have the bevy of graduate students and IT staff available to manage complex installations as the supercomputing centers do. That’s unfortunate since HPC solutions, especially those that use the latest technologies to achieve top performance, are complex and often require large staffs to manage, maintain, and keep running. Many commercial HPC installations have been blindsided by research-lab-driven complexity and downtime, watching their organization’s productivity and competitiveness suffer as schedules slipped.

Going for a compromise

Commercial users must make their HPC choices by considering performance, potential downtime, and management complexity trade-offs. When faced with such a decision, many commercial HPC users opt for what they see as a compromise. They often trade-off performance for simplicity and reliability, so their organizations can stay on mission, and just as importantly, so they can sleep at night.

A good example of this is what has happened with high-performance storage. Many commercial companies do not go for the GPFS, Lustre, and BeeGFS parallel file system solutions to deliver the highest performance because of their notorious complexity and unreliability, and instead select scale-out NAS, trading off performance for simplicity and reliability. They pay a premium for service and support to ensure uptime and off-load their management burden.

Source: Panasas, Inc.

For smaller deployment, users feel the performance is adequate. However, as they try to grow these systems, there is a significant performance drop off. The drop-off is related to the ease of use these systems tout. Specifically, to deliver simplicity on the front-end, the back-end handles chores. As a system scales and more data traffic must be accommodated, that back-end becomes overwhelmed.

Panasas, The Best of Both Worlds

Panasas offers a unique alternative: the performance of parallel file systems with the reliability and simplicity of scale-out NAS. Panasas ActiveStor® Ultra storage solutions deliver the high performance, low management, and high reliability needed in commercial HPC environments. And unlike scale-out NAS solutions, Panasas delivers consistent, superior performance that linearly scales. There is no performance drop off or erratic performance, as is commonly experienced with scale-out NAS systems.

At the heart of the Panasas HPC storage solution is the PanFS® parallel file system, the operating environment for the ActiveStor Ultra architecture. PanFS maximizes all storage media’s efficiency (NVMe Flash, low latency SSD, high capacity HDD, and NVRAM) in a seamless, total-performance storage system that automatically adapts to changing file sizes and workloads, delivering consistently superior performance for today’s demanding workloads. A scale-out object back-end supports limitless scaling, while optimal data placement and an internally balanced architecture boost efficiency—all with simple deployment, operation, and maintenance.

PanFS uses Dynamic Data Acceleration to optimize mixed-workload performance with rapid access to large and small files alike. Dynamic Data Acceleration provides all-hot data access, eliminating the complexity and manual intervention of tiered HPC storage systems, maximizing the performance of diverse storage media in a single, seamless storage system. ActiveStor Ultra with PanFS offers the industry’s leading price/performance in an appliance that maximizes simplicity, boosts reliability, and delivers the lowest TCO. With PanFS, commercial HPC users get the fastest parallel file system at any price point with enterprise-class reliability, frustration-free manageability, and great support.

Source: Panasas, Inc.

To learn more about how to meet commercial HPC demands, visit www.panasas.com.

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Watch Nvidia’s GTC21 Keynote with Jensen Huang Livestreamed Here at 8:30 am PT Today

April 12, 2021

Join HPCwire right here on Monday, April 12, at 8:30 am PT to see the Nvidia GTC21 keynote from Nvidia’s CEO, Jensen Huang, livestreamed in its entirety. Hosted by HPCwire, you can click to join the Huang keynote on our livestream to hear Nvidia’s expected news and... Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U.S. Entity List bars U.S. firms from supplying key technolog Read more…

Argonne Supercomputing Supports Caterpillar Engine Design

April 8, 2021

Diesel fuels still account for nearly ten percent of all energy-related U.S. carbon emissions – most of them from heavy-duty vehicles like trucks and construction equipment. Energy efficiency is key to these machines, Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new training and inference servers that will power the upcoming Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

AWS Solution Channel

Volkswagen Passenger Cars Uses NICE DCV for High-Performance 3D Remote Visualization

 

Volkswagen Passenger Cars has been one of the world’s largest car manufacturers for over 70 years. The company delivers more than 6 million automobiles to global customers every year, from 50 production locations on five continents. Read more…

What’s New in HPC Research: Tundra, Fugaku, µHPC & More

April 6, 2021

In this regular feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

Watch Nvidia’s GTC21 Keynote with Jensen Huang Livestreamed Here at 8:30 am PT Today

April 12, 2021

Join HPCwire right here on Monday, April 12, at 8:30 am PT to see the Nvidia GTC21 keynote from Nvidia’s CEO, Jensen Huang, livestreamed in its entirety. Hosted by HPCwire, you can click to join the Huang keynote on our livestream to hear Nvidia’s expected news and... Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

RIKEN’s Ongoing COVID Research Includes New Vaccines, New Tests & More

April 6, 2021

RIKEN took the supercomputing world by storm last summer when it launched Fugaku – which became (and remains) the world’s most powerful supercomputer – ne Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2021) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

Microsoft, HPE Bringing AI, Edge, Cloud to Earth Orbit in Preparation for Mars Missions

February 12, 2021

The International Space Station will soon get a delivery of powerful AI, edge and cloud computing tools from HPE and Microsoft Azure to expand technology experi Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire