A Different Approach to HPC Cloud Servicing

By Nicole Hemsoth

July 11, 2013

Cloud-based high performance computing often comes as a result of purchasing clusters on something like Amazon’s Cluster Compute Instances, where latencies are lower and parallelism is more easily achieved. Amazon already had a cloud computing service and realized there was a market to cater to applications requiring higher performance.

Another approach to supplying cloud-based HPC harkens back to the origins of Amazon’s cloud computing providing days. A company called Third Wave Systems (TWS) developed a new algorithm and high performance computing paradigm to solve machining simulation problems. In the same paper in which they introduced that method, they also outlined a plan to make such simulation capability available to those without the access to dedicated HPC resources.

“With the development of cloud computing,” their research states, “TWS is building the infrastructure for delivering AdvantEdge Software as a Service. In the SaaS model , AdvantEdge is hosted in the TWS HPC environment while customers remotely upload and submit AdvantEdge simulations via the Internet.”

In order for that to be possible, TWS must have an abundance of HPC resources that they do not always utilize. Much of the demand for cloud-based HPC is driven by the institutions who seek out burst capacity for their existing HPC clusters or those for whom buying those resources would not make sound financial sense.

These applications would be of the highest value to tool manufacturers. Below is a snapshot diagram of temperature variance for a drilling tool, as one can see by the temperature increase where a hypothetical drill would be contacting the surface matter.

That image details partially what TWS called ‘thermal-mechanical coupling’ and ‘contact correction,’ two features that are computationally intensive.

“The thermal-mechanical coupling and contact correction also entail a considerable amount of floating point operations and memory access cost,” the paper mentioned. “For a machining simulation with refined finite element mesh (>100,000 elements), the solution time running in sequential mode can take days or even weeks depending on the length of cut to be simulated. It is critical to reduce the solution time by improving the performance of the model”

Indeed, in order for their system to be a viable one to sell out as a SaaS, they had to make some tweaks to their algorithms such that it would run as a high performance system. According to TWS, they accomplished that by relying on OpenMP to power AdvatEdge, along with removing memory access bottlenecks in the context of thermal-mechanical coupling, as related by the research below:

“The data transfer for the thermal-mechanical coupling is found to be a performance bottleneck due to memory access. The implementation is optimized by coupling the two in a tighter manner such that the data exchange becomes more cache friendly. This change effectively removes the memory access bottleneck and significantly reduces the wall clock time for the operation.”

Overall, the HPC cluster consists of 23 12-core compute nodes, all with Intel Xeon X5680 processors along with four 40-core compute nodes of Intel Xeon E7-4870 multicore processors.

Their SaaS setup is relatively straightforward, drawing from application submissions over the internet. Once someone purchases time on the TWS system, they can, according to the report, run and track their applications through TWS’s web server. Per the report, “SaaS Web Server populates a SaaS Job Database, which keeps track of user accounts, company affiliations and simulation status, and the Web Server also allows users to track their simulations via querying into the aforementioned database. File Manager handles the file transfer between SaaS Client and TWS, which includes simulation input file upload and result file download.”

The setup that facilitates users’ interactions with the TWS HPC cluster is diagramed below.

Since security is of course always an issue, especially for manufacturers who would prefer to have their experiments and simulations kept to themselves, TWS plans to encrypt data transferring to its clusters through a secure socket layer mechanism.

This is certainly an interesting approach to providing access to HPC. TWS is covering a very specific use case in the sense that this operation is meant for manufacturers wanting to run simulations on optimizing their physical tools (like drills, etc.). Such simulations need only happen a few times over a product development’s lifecycle.

Genomic applications, which are data and computationally intensive, are a prime candidate to increase the scope of cloud-based HPC. The oil and gas industry, which would find a significant benefit in cheaply testing drill designs, generally have advanced tech setups due to their data-intensive nature. With that said, so does CERN and their adoption of cloud computing to foster scientific collaboration and to provide excess computing services is well documented.

It may be worth it for some companies to go with a cloud provider that specializes in exactly the applications they need. If this TWS SaaS experiment finds its targeted clientele and produces the high performance results that clientele is looking for in a secure fashion, it is conceivable that smaller but under-utilized HPC clusters could be rented out in a similar fashion.

 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be natively integrated into four of the world's most advanced qu Read more…

Computing-Driven Medicine: Sleeping Better with HPC

September 10, 2024

As a senior undergraduate student at Fisk University in Nashville, Tenn., Ifrah Khurram's calculus professor, Dr. Sanjukta Hota, encouraged her to apply for the Sustainable Research Pathways Program (SRP). SRP was create Read more…

LLNL Engineers Harness Machine Learning to Unlock New Possibilities in Lattice Structures

September 9, 2024

Lattice structures, characterized by their complex patterns and hierarchical designs, offer immense potential across various industries, including automotive, aerospace, and biomedical engineering. With their outstand Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, integrated, and secured data. Now scientists working at univer Read more…

xAI Colossus: The Elon Project

September 5, 2024

Elon Musk's xAI cluster, named Colossus (possibly after the 1970 movie about a massive computer that does not end well), has been brought online. Musk recently posted the following on X/Twitter: "This weekend, the @xA Read more…

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with performance benchmarks. In the first paper, Understanding Data Mov Read more…

Quantum Software Specialist Q-CTRL Inks Deals with IBM, Rigetti, Oxford, and Diraq

September 10, 2024

Q-CTRL, the Australia-based start-up focusing on quantum infrastructure software, today announced that its performance-management software, Fire Opal, will be n Read more…

NSF-Funded Data Fabric Takes Flight

September 5, 2024

The data fabric has emerged as an enterprise data management pattern for companies that struggle to provide large teams of users with access to well-managed, in Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Shutterstock 1897494979

What’s New with Chapel? Nine Questions for the Development Team

September 4, 2024

HPC news headlines often highlight the latest hardware speeds and feeds. While advances on the hardware front are important, improving the ability to write soft Read more…

Critics Slam Government on Compute Speeds in Regulations

September 3, 2024

Critics are accusing the U.S. and state governments of overreaching by including limits on compute speeds in regulations and laws, which they claim will limit i Read more…

Shutterstock 1622080153

AWS Perfects Cloud Service for Supercomputing Customers

August 29, 2024

Amazon's AWS believes it has finally created a cloud service that will break through with HPC and supercomputing customers. The cloud provider a Read more…

HPC Debrief: James Walker CEO of NANO Nuclear Energy on Powering Datacenters

August 27, 2024

Welcome to The HPC Debrief where we interview industry leaders that are shaping the future of HPC. As the growth of AI continues, finding power for data centers Read more…

CEO Q&A: Acceleration is Quantinuum’s New Mantra for Success

August 27, 2024

At the Quantum World Congress (QWC) in mid-September, trapped ion quantum computing pioneer Quantinuum will unveil more about its expanding roadmap. Its current Read more…

Everyone Except Nvidia Forms Ultra Accelerator Link (UALink) Consortium

May 30, 2024

Consider the GPU. An island of SIMD greatness that makes light work of matrix math. Originally designed to rapidly paint dots on a computer monitor, it was then Read more…

Atos Outlines Plans to Get Acquired, and a Path Forward

May 21, 2024

Atos – via its subsidiary Eviden – is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more…

AMD Clears Up Messy GPU Roadmap, Upgrades Chips Annually

June 3, 2024

In the world of AI, there's a desperate search for an alternative to Nvidia's GPUs, and AMD is stepping up to the plate. AMD detailed its updated GPU roadmap, w Read more…

Nvidia Shipped 3.76 Million Data-center GPUs in 2023, According to Study

June 10, 2024

Nvidia had an explosive 2023 in data-center GPU shipments, which totaled roughly 3.76 million units, according to a study conducted by semiconductor analyst fir Read more…

Shutterstock_1687123447

Nvidia Economics: Make $5-$7 for Every $1 Spent on GPUs

June 30, 2024

Nvidia is saying that companies could make $5 to $7 for every $1 invested in GPUs over a four-year period. Customers are investing billions in new Nvidia hardwa Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Google Announces Sixth-generation AI Chip, a TPU Called Trillium

May 17, 2024

On Tuesday May 14th, Google announced its sixth-generation TPU (tensor processing unit) called Trillium.  The chip, essentially a TPU v6, is the company's l Read more…

Shutterstock 1024337068

Researchers Benchmark Nvidia’s GH200 Supercomputing Chips

September 4, 2024

Nvidia is putting its GH200 chips in European supercomputers, and researchers are getting their hands on those systems and releasing research papers with perfor Read more…

Leading Solution Providers

Contributors

IonQ Plots Path to Commercial (Quantum) Advantage

July 2, 2024

IonQ, the trapped ion quantum computing specialist, delivered a progress report last week firming up 2024/25 product goals and reviewing its technology roadmap. Read more…

Intel’s Next-gen Falcon Shores Coming Out in Late 2025 

April 30, 2024

It's a long wait for customers hanging on for Intel's next-generation GPU, Falcon Shores, which will be released in late 2025.  "Then we have a rich, a very Read more…

Some Reasons Why Aurora Didn’t Take First Place in the Top500 List

May 15, 2024

The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more…

Department of Justice Begins Antitrust Probe into Nvidia

August 9, 2024

After months of skyrocketing stock prices and unhinged optimism, Nvidia has run into a few snags – a  design flaw in one of its new chips and an antitrust pr Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

MLPerf Training 4.0 – Nvidia Still King; Power and LLM Fine Tuning Added

June 12, 2024

There are really two stories packaged in the most recent MLPerf  Training 4.0 results, released today. The first, of course, is the results. Nvidia (currently Read more…

Spelunking the HPC and AI GPU Software Stacks

June 21, 2024

As AI continues to reach into every domain of life, the question remains as to what kind of software these tools will run on. The choice in software stacks – Read more…

Quantum Watchers – Terrific Interview with Caltech’s John Preskill by CERN

July 17, 2024

In case you missed it, there's a fascinating interview with John Preskill, the prominent Caltech physicist and pioneering quantum computing researcher that was Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire