Using AI to Solve One of the Most Prevailing Problems in CFD

By James Sharpe

October 17, 2019

In this guest article, James Sharpe, MMATH, Lead for Big Data & Security at Zenotech, explores the application of AI technology to the challenge of computational mesh generation and the implications for engineering sectors.

How can artificial intelligence (AI) and high-performance computing (HPC) solve mesh generation, one of the most commonly referenced problems in computational engineering? A new study has set out to answer this question and create an industry-first AI-mesh application to improve this previously time-consuming and iterative process. It has resulted in a mesh that is five to ten times more efficient than when generated manually. 

AI is attracting all the buzz right now, but inevitably, with the hype, the field has become awash with applications that are not designed to solve existing problems. There is undoubtedly a great temptation to use AI to improve CFD methods, often based on the raw substitution of AI data for simulation data. However, these tend not to work effectively, or to require orders of magnitude more training data than would be necessary to run the simulation. 

This investigation (led by Zenotech with AI specialists, AlgoLab) began with a comprehensive assessment of the potential for deploying AI technology into digital engineering processes. After a series of down-selects, the automated generation of computational meshes for a specialist application domain appeared as the likely candidate. 

The project concentrated on creating a reusable framework for training AI algorithms with real datasets. The process generated has been applied to the task of creating meshes for wind energy resource assessment, which is typically a time-pressured activity, where turnaround and accuracy are business-critical.

The new meshing process makes use of a set of rules, derived from physical properties of the terrain (height, gradient, curvature, terrain type) and the location of a specific point of interest. In the case of wind energy, this includes met masts, likely turbine locations or other existing data sources. Each rule is applied to every point on the terrain specification, with the AI algorithm responsible for determining the relative importance of each rule at each point and the appropriate set of parameter values that convert rules into mesh spacing. The resulting set of meshing instructions has O(1 million) variables for any given test case.  

As the training dataset relies on the repeated application of the real CFD-based wind analysis process (which is computationally expensive) and a comparison with a known highly accurate solution, the AI approach is designed to evaluate the minimum number of points to learn the parameter space. A Gaussian Process Model was selected as the most natural choice for this problem.

The implementation of the AI process makes use of the GPFlowOpt Python library (Knudde et al, 2017) using TensorFlow, with a Matern52 statistical covariance function. An initial 300 points were selected using LatinHyperCube sampling (equivalent to N rooks on a chessboard without threatening each other). New points to be evaluated are implemented using Hypervolume-based Probability of Improvement method [Ivo Couckuyt et al, 2014l] providing a fast calculation of the multi-objective probability of improvement and expected improvement criteria for Pareto optimization. (see Journal of Global Optimization, Vol 60, pp 575 – 594). 

The Hypervolume method constructs a Pareto front to select the next points to evaluate. Two objective functions are defined to be minimized: (i) the cell count in generated mesh (a good measure of the expense of the CFD simulation), and (ii) the RMS error of the generated flow solution at experimental data points. The resulting Pareto front and associated parameter settings at each point compose a lookup table that provides the optimal meshing rules for a given level of accuracy.  

The process can now be run automatically, and typically generates a mesh that is five to 10 times more efficient than one created manually. A vast number of training datasets have been produced in the process. Another benefit is that the process parameters are generic and therefore can be applied to new test cases without the need for additional training.  

The use of commodity computing and advanced hardware via EPIC, an online portal to high performance computing was a vital component. This delivers the scalability and processing power to (affordably) train datasets based on numerical experiments.

The results have led to process improvements that have already been deployed on two commercial projects, supporting growth and export in the wind energy sector. These types of projects have typically relied on lower-fidelity computational engineering methods to deliver timely results, and the new process makes it possible to deploy high-fidelity methods in the same timescale.   

The capability developed will now be further extended to include more data feedback to the automation process, and these methods can now be transferred to other engineering sectors.

About the Author 

James Sharpe is a specialist in computer science and software engineering at Zenotech Ltd. While at BAE Systems Advanced Technology Centre, James developed new mathematical algorithms for the latest in high performance computing hardware and led development teams in Applied Intelligence – working at the forefront of cybersecurity. James is the Zenotech lead for Big Data and Security. 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

HPC Career Notes: April 2023 Edition

April 1, 2023

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it’s a promotion, new company hire, or even an accolade, we’ Read more…

Q&A with Dorian C. Arnold, SC23 General Chair, and an HPCwire Person to Watch in 2023

March 31, 2023

SC23 General Chair Dorian C. Arnold is enthusiastic about this year's conference, which will take place Nov. 12-17 in Denver, Colo. Our exclusive interview with Arnold covers his history with the annual event, what's in store for attendees, and his insights into the HPC landscape writ large. In addition to his work with SC, Arnold is also... Read more…

Intel Issues Roadmap Update, Aims for ‘Scheduled Predictability’

March 30, 2023

Intel held an investor webinar yesterday, with the chip giant working to project consistency and confidence amid slipping roadmaps and market share. At the event, Intel primarily focused on where it stands with four (!) Read more…

Intel’s Server Chips Are ‘Lead Vehicles’ for Manufacturing Strategy

March 30, 2023

…But chipmaker still does not have an integrated product strategy, which puts the company behind AMD and Nvidia. Intel finally has a full complement of server and PC chips it will release in the coming years, which will determine whether it has regained its leadership in chip manufacturing. The chipmaker this week... Read more…

JPMorgan Chase, QC Ware Report Progress in Quantum DL for Deep Hedging

March 30, 2023

Hedging is, of course, a ubiquitous practice in FS and there are well-developed classical computational approaches for implementing this risk mitigation strategy. The challenge has been the computational cost and time-to Read more…

AWS Solution Channel

Shutterstock 531739477

Checkpointing HPC applications using the Spot Instance two-minute notification from Amazon EC2

Amazon Elastic Compute Cloud (Amazon EC2) offers a wide-range of compute instances at different price points, all designed to match different customer’s needs. You can further optimize cost by choosing Reserved Instances (RIs) and even Spot Instances. Read more…

 

Get the latest on AI innovation at NVIDIA GTC

Join Microsoft at NVIDIA GTC, a free online global technology conference, March 20 – 23 to learn how organizations of any size can power AI innovation with purpose-built cloud infrastructure from Microsoft. Read more…

Destination Earth Takes Form as EuroHPC’s Flagship Workload

March 30, 2023

When the EuroHPC Summit was held last week in Gothenburg, there was a distinct shift in tone for the maturing supercomputing play. With LUMI and Leonardo – plus four other petascale systems – already operational, the Read more…

Intel Issues Roadmap Update, Aims for ‘Scheduled Predictability’

March 30, 2023

Intel held an investor webinar yesterday, with the chip giant working to project consistency and confidence amid slipping roadmaps and market share. At the even Read more…

Intel’s Server Chips Are ‘Lead Vehicles’ for Manufacturing Strategy

March 30, 2023

…But chipmaker still does not have an integrated product strategy, which puts the company behind AMD and Nvidia. Intel finally has a full complement of server and PC chips it will release in the coming years, which will determine whether it has regained its leadership in chip manufacturing. The chipmaker this week... Read more…

Destination Earth Takes Form as EuroHPC’s Flagship Workload

March 30, 2023

When the EuroHPC Summit was held last week in Gothenburg, there was a distinct shift in tone for the maturing supercomputing play. With LUMI and Leonardo – pl Read more…

What’s Stirring in Nvidia’s R&D Lab? Chief Scientist Bill Dally Provides a Peek

March 28, 2023

In what’s become a regular GPU Technology Conference feature, Bill Dally, Nvidia chief scientist and SVP of research, provides a glimpse into how Nvidia organ Read more…

Cost-effective Fork of GPT-3 Released to Scientists

March 28, 2023

Researchers looking to create a foundation for a ChatGPT-style application now have an affordable way to do so. Cerebras is releasing open-source learning models for researchers with the ingredients necessary to cook up their own ChatGPT-AI applications. The open-source tools include seven models that form a learning... Read more…

Pegasus ‘Big Memory’ Supercomputer Now Deployed at the University of Tsukuba

March 25, 2023

In the bevy of news from Nvidia's GPU Technology Conference this week, another new system has come to light: Pegasus, which entered operations at the University Read more…

EuroHPC Summit: Tackling Exascale, Energy, Industry & Sovereignty

March 24, 2023

As the 2023 EuroHPC Summit opened in Gothenburg on Monday, Herbert Zeisel – chair of EuroHPC’s Governing Board – commented that the undertaking had “lef Read more…

Nvidia Doubling Down on China Market in the Face of Tightened US Export Controls

March 23, 2023

Chipmakers are tightlipped on China activities following a U.S. crackdown on hardware exports to the country. But Nvidia remains unfazed, and is doubling down o Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

SC22 Booth Videos

AMD @ SC22
Altair @ SC22
AWS @ SC22
Ayar Labs @ SC22
CoolIT @ SC22
Cornelis Networks @ SC22
DDN @ SC22
Dell Technologies @ SC22
HPE @ SC22
Intel @ SC22
Intelligent Light @ SC22
Lancium @ SC22
Lenovo @ SC22
Microsoft and NVIDIA @ SC22
One Stop Systems @ SC22
Penguin Solutions @ SC22
QCT @ SC22
Supermicro @ SC22
Tuxera @ SC22
Tyan Computer @ SC22
  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire