An Overview of ‘OpenACC for Programmers’ from the Book’s Editors

By Sunita Chandrasekaran and Guido Juckeland

June 20, 2018

In an era of multicore processors coupled with manycore accelerators in all kinds of devices from smartphones all the way to supercomputers, it is important to train current and future computational scientists of all domains the art of parallel programming. More and more colleges and universities have begun to integrate this as a mandatory course into their undergraduate computer science programs and also as an offer in the graduate/Ph.D. programs in computational science domains. In a time of rapidly evolving processor and accelerator architectures, the training material should have a longevity that lasts beyond next generation of hardware. As such more abstract programming models such as directive-based parallelization approaches offer both platform and performance portability and at the same time they also convey all the important concepts of parallel programming that can be easily transferred to other paradigms.

One such directive-based programming model is OpenACC, which has rapidly gained momentum over the past few years among scientific application users. OpenACC now accelerates ANSYS Fluent (CFD) and Gaussian (Quantum Chemistry) and VASP (Material Science), which are among the top 10 HPC applications, as well as selected ORNL Center for Accelerated Application Readiness (CAAR) codes to be run on the future CORAL Supercomputer: GTC (Physics), XGC (Physics), LSDalton (Quantum Chemistry), ACME(CWO), and FLASH (Astrophysics).

The book OpenACC for Programmers: Concepts and Strategies (published by Addison-Wesley Professional, September 20, 2017; edited by Sunita Chandrasekaran and Guido Juckeland) provides comprehensive and practical overviews of using the parallel programming model for heterogeneous computing systems. This book integrates contributions from 19 leading parallel programming experts from academia, public research organizations and industry. The text is written in a modular manner in a way that instructors can pick a chapter or chapters of their choice to include into their existing parallel programming curriculum. On the other hand, the book is comprehensive enough to be used for a tutorial or bootcamp on OpenACC. The chapters are stacked in a way that helps the reader to incrementally master the art of parallel programming. The editors have also built a GitHub course that is populated with example codes and chapters’ exercise solutions enabling instructors to create homework assignments.

The book begins its narrative on the basic concepts of OpenACC and the different types of parallelism exposed by the programming model in order to achieve performance without losing portability. One of the most important topics in parallel programming is profiling. How do you identify hot spots? How do you identify performance bottlenecks? Chapter 3 explains it all. This chapter demonstrates use of performance analysis tools, profilers and debugging tools such as the Nvidia profiler, Score-P & Vampir, TAU and Allinea’s DDT with nice visualization pictures for easy takeaways.

Are you new to OpenACC and keen to learn how to write your first program? Chapter 4 helps you take baby steps on how to build your first OpenACC program in both C and Fortran. This is a go-to chapter for a beginner learning to build and compile his/her code with the most commonly used OpenACC directives. The chapter also offers tips on how one can improve the code, serving as a mini best practice guide.

Do you want to know more about what happens under the hood? Look for Chapter 5 to read about what a compiler can and cannot do. The chapter concludes with some intriguing questions that could easily be converted into a class assignment or quiz.

Often, the scientific developers are looking for ways to incrementally improve performance. This leads to some fine tuning of the directives added to the code. Learning about some of the best practices can be quite useful in such scenario. Chapter 6 offers several do’s and don’t tips to the developers that often comes handy.

The book also has case studies demonstrating the usability of OpenACC on kernel as well as application benchmarks. Chapter 7 presents realistic examples where the authors from the Oak Ridge National Lab talk about a cosmology application, HACC, which is part of the CORAL benchmark suite. The authors discuss the performance portability of OpenACC directives across architectures.

To fulfill the goal of a general parallel programming training, the author of Chapter 8 highlights key features of several other approaches such as CUDA, OpenMP, OpenCL, C++ AMP, RAJA, Kokkos, TBB among others. This will give the readers a good understanding of additional parallel programming approaches and the mapping of the learned OpenACC constructs to them.

Are you looking to interoperate OpenACC with native or low-level APIs to program heterogeneous systems? Or interested to know more about how to program multiple devices available in order to maximize performance? Learn more in advanced chapters 9 and 10. Such discussions are very timely especially when we have supercomputers such as Summit where a single node consists of six Nvidia V100 cards per two Power9 CPUs.

Last but not the least, Chapters 11 and 12 can offer students and readers food for thought. A handful of authors who have provided support for OpenACC in research compilers such as OpenARC, XcalableACC, OpenUH and Sunway OpenACC narrate their experiences and share novel ideas of language extensions and optimizations. These ideas can help brainstorm how to enhance the language feature set of OpenACC, its compiler and runtime implementations for hardware architectures that are rapidly evolving.

With all this knowledge the readers are now well capable of developing their own parallel programs and, thus, fully utilizing all resources in a modern (heterogeneous) computing platform. In combination with the exercise questions at the end of each chapter, their solutions and code examples on GitHub, the book caters not only to both the “classical” educators and their students, but also to the domain scientists and practitioners. Parallel programming is such a fundamental skill that has grown beyond the traditional HPC community. High level programming approaches such as OpenACC provide a manageable learning curve for novices and this book is designed to be a guide on this journey.


Sunita Chandrasekaran is an assistant professor in Computer and Information Sciences and an affiliated faculty with the Center for Bioinformatics & Computational Biology (CBCB) at the University of Delaware. She has coauthored chapters in the books Programming Models for Parallel Computing, published by MIT Press, and Parallel Programming with OpenACC, published by Elsevier, 2016. Her research areas include exploring high-level programming models and its language extensions, building compiler and runtime implementations and validating and verifying implementations and their conformance to standard specifications. She is a member of the OpenMP, OpenACC, and SPEC HPG communities. Dr. Chandrasekaran earned her PhD in computer science engineering from Nanyang Technological University (NTU), Singapore, for creating a high-level software stacks for FPGAs.

Guido Juckeland founded the Computational Science Group at Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Germany. He is responsible for designing and implementing end-to-end Research IT-workflows together with scientists and IT experts at HZDR. His research focuses on better usability and programmability for hardware accelerators and application performance monitoring as well as optimization. He is the vice-chair of the SPEC High Performance Group (HPG), an active member of the OpenACC technical and marketing committees, and also contributes to the OpenMP tools working group. Guido earned his PhD in computer science from Technische Universität Dresden, Germany, for his work on trace-based performance analysis for hardware accelerators.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Watch Nvidia’s GTC21 Keynote with Jensen Huang Livestreamed Here, Monday at 8:30am PT

April 9, 2021

Join HPCwire right here on Monday, April 12, at 8:30 am PT to see the Nvidia GTC21 keynote from Nvidia’s CEO, Jensen Huang, livestreamed in its entirety. Hosted by HPCwire, you can click to join the Huang keynote on our livestream to hear Nvidia’s expected news and... Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U.S. Entity List bars U.S. firms from supplying key technolog Read more…

Argonne Supercomputing Supports Caterpillar Engine Design

April 8, 2021

Diesel fuels still account for nearly ten percent of all energy-related U.S. carbon emissions – most of them from heavy-duty vehicles like trucks and construction equipment. Energy efficiency is key to these machines, Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new training and inference servers that will power the upcoming Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

AWS Solution Channel

Volkswagen Passenger Cars Uses NICE DCV for High-Performance 3D Remote Visualization

 

Volkswagen Passenger Cars has been one of the world’s largest car manufacturers for over 70 years. The company delivers more than 6 million automobiles to global customers every year, from 50 production locations on five continents. Read more…

What’s New in HPC Research: Tundra, Fugaku, µHPC & More

April 6, 2021

In this regular feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

The US Places Seven Additional Chinese Supercomputing Entities on Blacklist

April 8, 2021

As tensions between the U.S. and China continue to simmer, the U.S. government today added seven Chinese supercomputing entities to an economic blacklist. The U Read more…

Habana’s AI Silicon Comes to San Diego Supercomputer Center

April 8, 2021

Habana Labs, an Intel-owned AI company, has partnered with server maker Supermicro to provide high-performance, high-efficiency AI computing in the form of new Read more…

Intel Partners Debut Latest Servers Based on the New Intel Gen 3 ‘Ice Lake’ Xeons

April 7, 2021

Fresh from Intel’s launch of the company’s latest third-generation Xeon Scalable “Ice Lake” processors on April 6 (Tuesday), Intel server partners Cisco, Dell EMC, HPE and Lenovo simultaneously unveiled their first server models built around the latest chips. And though arch-rival AMD may... Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

RIKEN’s Ongoing COVID Research Includes New Vaccines, New Tests & More

April 6, 2021

RIKEN took the supercomputing world by storm last summer when it launched Fugaku – which became (and remains) the world’s most powerful supercomputer – ne Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

AI Systems Summit Keynote: Brace for System Level Heterogeneity Says de Supinski

April 1, 2021

Heterogeneous computing has quickly come to mean packing a couple of CPUs and one-or-many accelerators, mostly GPUs, onto the same node. Today, a one-such-node system has become the standard AI server offered by dozens of vendors. This is not to diminish the many advances... Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2021) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

Microsoft, HPE Bringing AI, Edge, Cloud to Earth Orbit in Preparation for Mars Missions

February 12, 2021

The International Space Station will soon get a delivery of powerful AI, edge and cloud computing tools from HPE and Microsoft Azure to expand technology experi Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire