Teaching the World About Intel Xeon Phi: An Interview with Rob Farber

October 14, 2014

Rob Farber is the founder and CEO of TechEnablement, a firm that provides education, planning, analysis and code tutorials, with an emphasis on HPC. In this interview, Rob gives his perspective on the direction of HPC technology and the urgent need for code modernization. He also discusses the newest book by James Reinders and Jim Jeffers, High Performance Parallelism Pearls, which distills the experience of sixty-nine HPC experts into twenty-eight chapters designed to teach the world about the performance capabilities of the massively-parallel Intel Xeon Phi family of products.

Here’s what Rob had to say:

Basically, when our firm looks at the world of technology through the lens of tech enablement, what we see is a tremendous demand for HPC everywhere that makes full use of today’s and tomorrow’s massively parallel computers. Technology is the key. For example, today, many HPC organizations are starting massive code optimization or modernization efforts using the Intel Xeon Phi coprocessor in order to prepare for Knights Landing, the next generation of Intel’s powerful Xeon Phi processors that will be available in the near future.

Why is this cool? Why will everyone involved with technology be interested? It’s because we are moving into the world of plug-and-play supercomputing. You buy a box, plug in power, plug into a network and “Voilá!” you have a massively parallel SMP and MPI cluster powered by Knights Landing. Think how plug and play peripherals changed the world and extrapolate its impact on HPC. In other words, “HPC Everywhere”.

We have an undeniable need for code modernization so everyone around the world can use this new technology. It’s really exciting. Reinders and Jeffers saw this market need and created a textbook that includes downloadable working code and figures as teaching aids.

High Performance Parallelism PearlsI see the book, High Performance Parallelism Pearls, as vital to helping code developers understand parallel programming with solid lessons that will result in performance gains today while preparing us for the brave new world of Knights Landing. There is a tremendous potential demand for “HPC Everywhere”, but only if people can modernize their applications to use this new massively parallel hardware. Remember that most applications were developed when four cores was a lot, and running wide vector instructions like the AVX-512 was simply not possible.

For an organization to be competitive, or for research organizations to continue advancing scientific discovery, it has become vitally important for their developers to take advantage of new technology because the demand for HPC everywhere is on the rise. For example, because of the compute power now available, rendering is becoming a cottage industry. Embree, Intel’s ray tracing package that runs well on Xeon and Intel Xeon Phi, is discussed in one of the chapters in High Performance Parallelism Pearls.

Augmented reality, which I refer to as the gold rush of the 20-Teens, needs amazing animations; this creates a huge demand for HPC everywhere by people who wish to create highly detailed, photorealistic animations for really cool augmented reality applications. Think of cottage shops filled with people developing animations and selling them – a great boon to the gaming community. Now extrapolate from rendering of characters and monsters to 3D printing of toys and component assembly to get a sense of the value multiplier.

And look at deep learning, my particular area of expertise. The teaching code in my chapter “Deep-learning and Numerical Optimization” is able to exceed a teraflop per second of sustained performance on a single Intel Xeon Phi. On the TACC Stampede supercomputer, I observed that 3,000 Intel Xeon Phi can deliver over 2.2 petaflop/s of average sustained performance. Deep learning is revamping everything from web search engines – Google, Bing, and all the rest – to autonomous vehicles ranging from people flying drones down wooded paths to self-driving cars moving over the roadways.

So, because HPC is everywhere, what we need to do is modernize these applications to make use of capabilities of Knight’s Landing. And there is no compelling reason to delay. Modernization efforts managed today on the Xeon Phi coprocessor will deliver the improved performance on Xeon-based systems as well. The performance gains will carry forward.

For example, in the new Reinders / Jeffers book, an introductory article by Gilles Civario and Michale Lysaght is a tutorial that walks you through a simple N-body code, taking you basically from “hello world” to running the code efficiently. There is another chapter by Rio Yokota and Mustafa Abdul-Jabbar, which discusses their exascale-capable, production-ready implementation of that same computation. Also in the book, production-ready code is part of the educational process – e.g. NWChem from PNNL (Pacific Northwest National Laboratory).

As I mentioned, High Performance Parallelism Pearls is a teaching book that provides code and figures that instructors can work with. In fact, there is so much information in the book that I was forced to create an overview article, “Teaching The World About Intel Xeon Phi” with links to bite-sized consumables about each chapter to help readers decide if they want the book. Even when you own the book, you can examine links in my article to find what interests you very quickly.

The material in the book is an excellent way to get a picture of how HPC is evolving, especially when it comes to code modernization being driven by new technology. Jason Sewall and Guillaume Colin de Verdière poetically say this as “a rising tide lifts all boats.”

This is part of our mission. At TechEnablement we focus on enabling people with technology, making sure to recognize the people who are doing the work – after all technology is a human endeavor. It’s great for their career, helps them get funding, and inspires students and others to move into technology. We provide detailed tutorials so those who want to become involved with technology can dig in to working code and get their hands dirty.

We also provide high level summaries for senior scientists, technologists and people in procurement – the idea is to enable the entire lifecycle of new technology, including funding. So we provide information about funding opportunities to connect the technology with the people and the people to funding. Everybody wins.

High Performance Parallelism Pearls will quickly become one of the most important teaching documents for parallel programming, and will go a long way toward making HPC everywhere a reality.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing ( Read more…

By John Russell

Ethernet Technology Consortium Launches 800 Gigabit Ethernet Specification

April 7, 2020

The newly rebranded Ethernet Technology Consortium (ETC), formerly known as the 25 Gigabit Ethernet Consortium, announced a new 800 Gigabit Ethernet specification and an expanded scope aimed at meeting the needs of perfo Read more…

By Tiffany Trader

Spanish Researchers Introduce HPC-Ready COVID-19 Spread Simulator

April 7, 2020

With governments in a mad scramble to identify the policies most likely to curb the spread of the pandemic without unnecessarily crippling the global economy, researchers are turning to AI and high-performance computing Read more…

By Oliver Peckham

Stony Brook Researchers to Run COVID-19 Simulations on Supercomputers

April 6, 2020

A wide range of supercomputers are crunching the infamous “spike” protein of the novel coronavirus, from Summit more than a month ago to [email protected] to a Russian cluster just a week ago. Read more…

By Staff report

What’s New in Computing vs. COVID-19: Fast-Tracked Research, Susceptibility Study, Antibodies & More

April 6, 2020

Supercomputing, big data and artificial intelligence are crucial tools in the fight against the coronavirus pandemic. Around the world, researchers, corporations and governments are urgently devoting their computing reso Read more…

By Oliver Peckham

AWS Solution Channel

Amazon FSx for Lustre Update: Persistent Storage for Long-Term, High-Performance Workloads

Last year I wrote about Amazon FSx for Lustre and told you how our customers can use it to create pebibyte-scale, highly parallel POSIX-compliant file systems that serve thousands of simultaneous clients driving millions of IOPS (Input/Output Operations per Second) with sub-millisecond latency. Read more…

Army Seeks AI Ground Truth

April 3, 2020

Deep neural networks are being mustered by U.S. military researchers to marshal new technology forces on the Internet of Battlefield Things. U.S. Army and industry researchers said this week they have developed a “c Read more…

By George Leopold

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems Read more…

By John Russell

Ethernet Technology Consortium Launches 800 Gigabit Ethernet Specification

April 7, 2020

The newly rebranded Ethernet Technology Consortium (ETC), formerly known as the 25 Gigabit Ethernet Consortium, announced a new 800 Gigabit Ethernet specificati Read more…

By Tiffany Trader

ECP Milestone Report Details Progress and Directions

April 1, 2020

The Exascale Computing Project (ECP) milestone report issued last week presents a good snapshot of progress in preparing applications for exascale computing. Th Read more…

By John Russell

Pandemic ‘Wipes Out’ 2020 HPC Market Growth, Flat to 12% Drop Expected

March 31, 2020

As the world battles the still accelerating novel coronavirus, the HPC community has mounted a forceful response to the pandemic on many fronts. But these efforts won't inoculate the HPC industry from the economic effects of COVID-19. Market watcher Intersect360 Research has revised its 2020 forecast for HPC products and services, projecting... Read more…

By Tiffany Trader

LLNL Leverages Supercomputing to Identify COVID-19 Antibody Candidates

March 30, 2020

As COVID-19 sweeps the globe to devastating effect, supercomputers around the world are spinning up to fight back by working on diagnosis, epidemiology, treatme Read more…

By Staff report

Weather at Exascale: Load Balancing for Heterogeneous Systems

March 30, 2020

The first months of 2020 were dominated by weather and climate supercomputing news, with major announcements coming from the UK, the European Centre for Medium- Read more…

By Oliver Peckham

Q&A Part Two: ORNL’s Pooser on Progress in Quantum Communication

March 30, 2020

Quantum computing seems to get more than its fair share of attention compared to quantum communication. That’s despite the fact that quantum networking may be Read more…

By John Russell

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

Julia Programming’s Dramatic Rise in HPC and Elsewhere

January 14, 2020

Back in 2012 a paper by four computer scientists including Alan Edelman of MIT introduced Julia, A Fast Dynamic Language for Technical Computing. At the time, t Read more…

By John Russell

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Fujitsu A64FX Supercomputer to Be Deployed at Nagoya University This Summer

February 3, 2020

Japanese tech giant Fujitsu announced today that it will supply Nagoya University Information Technology Center with the first commercial supercomputer powered Read more…

By Tiffany Trader

Tech Conferences Are Being Canceled Due to Coronavirus

March 3, 2020

Several conferences scheduled to take place in the coming weeks, including Nvidia’s GPU Technology Conference (GTC) and the Strata Data + AI conference, have Read more…

By Alex Woodie

Leading Solution Providers

SC 2019 Virtual Booth Video Tour

AMD
AMD
ASROCK RACK
ASROCK RACK
AWS
AWS
CEJN
CJEN
CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
IBM
IBM
MELLANOX
MELLANOX
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
SIX NINES IT
SIX NINES IT
VERNE GLOBAL
VERNE GLOBAL
WEKAIO
WEKAIO

Cray to Provide NOAA with Two AMD-Powered Supercomputers

February 24, 2020

The United States’ National Oceanic and Atmospheric Administration (NOAA) last week announced plans for a major refresh of its operational weather forecasting supercomputers, part of a 10-year, $505.2 million program, which will secure two HPE-Cray systems for NOAA’s National Weather Service to be fielded later this year and put into production in early 2022. Read more…

By Tiffany Trader

Exascale Watch: El Capitan Will Use AMD CPUs & GPUs to Reach 2 Exaflops

March 4, 2020

HPE and its collaborators reported today that El Capitan, the forthcoming exascale supercomputer to be sited at Lawrence Livermore National Laboratory and serve Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

IBM Unveils Latest Achievements in AI Hardware

December 13, 2019

“The increased capabilities of contemporary AI models provide unprecedented recognition accuracy, but often at the expense of larger computational and energet Read more…

By Oliver Peckham

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

IBM Debuts IC922 Power Server for AI Inferencing and Data Management

January 28, 2020

IBM today launched a Power9-based inference server – the IC922 – that features up to six Nvidia T4 GPUs, PCIe Gen 4 and OpenCAPI connectivity, and can accom Read more…

By John Russell

Summit Joins the Fight Against the Coronavirus

March 6, 2020

With the coronavirus sweeping the globe, tech conferences and supply chains are being hit hard – but now, tech is hitting back. Oak Ridge National Laboratory Read more…

By Staff report

CINECA’s Carlo Cavazzoni Describes the Supercomputing Battle Against COVID-19

March 17, 2020

The latest episode of the This Week in HPC podcast features Carlo Cavazzoni, a senior staff member at CINECA, one of the leading supercomputing organizations in Europe. Intersect360 Research's Addison Snell spoke to Cavazzoni to discuss both CINECA's work using supercomputing to combat COVID-19 and Cavazzoni's personal experience living near the epicenter... Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This