What Knights Landing Is Not

By James Reinders, Intel

June 18, 2016

As we get ready to launch the newest member of the Intel Xeon Phi family, code named Knights Landing, it is natural that there be some questions and potentially some confusion.

I have found that everything is clear, when we really understand that Knights Landing is an Intel processor. That makes it NOT Knights Corner. That makes it NOT a GPU. That makes it NOT a PCIe limited accelerator. That makes it NOT force large, new, and unique investments in software programming.

Perhaps everything is most clear when we discuss what it is and what it is not.

Knights Landing is NOT Knights Corner

Knights Corner, the first Intel Xeon Phi product, was a coprocessor. Knights Corner has been extraordinarily successful powering many of the world’s fastest computers. Nevertheless, Knights Corner required a hot processor, shuffling of data over the PCIe bus, and often the use of offload-style programming due to limited memory capacity and strong Amdahl’s Law effects when running less parallel code.

Knights Landing, as a processor, is a very easy upgrade for a Knights Corner user. Applications that used Knights Corner run even better on Knights Landing. Even bigger news is this: applications which were never able to adapt to the limitations of Knights Corner (or offloading to GPUs for that matter) will find Knights Landing an exciting option.


Knights Landing is NOT a GPU (neither was Knights Corner)

Knights Landing is a full-fledged, highly scalable, Intel processor. This processor can reach unprecedented levels of performance and parallelism, without giving up programmability. You can use the same parallel programming models, the same tools, and the same binaries that run today on other Intel processors.

Programming languages that work for processors, just work for Knights Landing too. Programming models, like OpenMP, MPI and TBB, just work for Knights Landing also.

Restrictive models tailored for GPUs, including kernel programming in CUDA and OpenCL, do not apply to processors (and I’m not talking just about Intel processors). We do not need them, because we have the full richness and portability of processor programming models fully available on Knights Landing.

Knights Landing is NOT going to invalidate prior processor coding efforts

It’s Knights Landing that really brings us home. It’s a full processor from Intel, one that happens to have up to 72 cores. It has an unprecedented ability to perform on highly parallel programs while being compatible with the tools and programming models common to Intel processors.

One of the first things I did when I initially logged on to a Knights Landing machine was to type in “yum install emacs.” I’m sure that whoever built that emacs binary had never heard of Knights Landing. It worked and I was happy to have the power of emacs so as to no be slowed by the primitive “vi.” I am so happy that software just runs, without a recompilation needed. No need to do something weird with Knights Landing to use it with your favorite software. It’s just like any other processor from Intel in that respect! It can run anything you would expect a processor to run: C, C++, Fortran, Python, and much more. It really is a full processor!

We think that parallel programming is challenging enough. That’s why we took a different approach compared to other device designs – especially GPUs. Our goal has been to deliver never before attainable processor performance while remaining compatible with existing software and tools. It’s quite an accomplishment.

Reinders-KNL-FullCover
Front jacket for “Intel Xeon Phi Processor High Performance Programming, Knights Landing Edition” by James Reinders, Jim Jeffers and Avinash Sodani

Knights Landing is NOT inflexible

When we are considering the design for a new computer, we ask a variety of basic questions, consider options, make choices, and bake a set of choices into a design. In the past, when the topic of using high bandwidth memory came up, there as always a debate: should we make it a cache or should we make it a scratchpad memory? And that, of course, depends to a certain extent on whether your application is cache-friendly – and most are – or if it’s one of those apps that is not cache-friendly and you think you can do better with scratch pad memory. Previously, we generally had to design the computer choosing one approach or the other and then live with the decision. With Knights Landing, we offer choices which make Knights Landing amazingly versatile.

Knights Landing integrates high bandwidth memory known as MCDRAM which greatly enhances performance.

Unprecedented configurability allows it to be operated in different “memory modes.” MCDRAM can either be treated as a high bandwidth memory-side cache, or it can be identified as high bandwidth memory, or a little of each. Knights Landing also supports different “cluster modes,” allowing it to behave as a cluster with one, two or four NUMA domains.

Reinders-KNL-Chapter17
Source: “Intel Xeon Phi Processor High Performance Programming, Knights Landing Edition,” 2016; used with permission – click to enlarge

As Jim Jeffers and I say in our book on Knights Landing, “Knights Landing offers an unprecedented variety of configurations which have traditionally been available only as hardwired and unchangeable design decisions. Specifically, the choices realized by the cluster modes and the memory modes. This wide ranging support allows Knights Landing to act like very different machines based on the configuration used to initialize the CPU, the operating system, and then the applications.” This means that Knights Landing can be adapted to fit application needs.

Knights Landing is NOT limited by small memory and offloading

Knights Landing processors support up to 384 GB DDR using 6 channels (~90GBs sustained bandwidth) memory and do not require applying offload constructs to hot spots because an entire application will run on the processor itself.

Reinders-KNL-Chapter22
Source: “Intel Xeon Phi Processor High Performance Programming, Knights Landing Edition,” 2016; used with permission – click to enlarge

Consider the weather forecasting program called WRF (Weather Research and Forecasting). It does not have just a few hot spots where it does all its computations – instead it has a huge number of algorithms used to solve different problems. There are many parts of the application that you would like to run very fast, especially the particularly complex algorithms. Since it all runs on Knights Landing, we’ve seen very nice results, which I have documented in chapter 22 of the new Knights Landing book, coupled with the ease of using the same code as we would on any processor. Programs like this are essentially an insurmountable challenge for a GPU or coprocessor.

Machine learning and data analytics will receive a boost from the introduction of Knights Landing2 . Both tend to apply computational models to large datasets – the constraints have always been the amount of data you can handle given the computational power available to you. Knights Landing is a highly scalable, highly parallel device that is well suited to handle large, complex computations. Because it is a processor rather than a coprocessor, the Intel Xeon Phi technology provides you with more access to your data. Best of all you are working with an on-package, very large processor-sized memory without the limits of any offload device (coprocessor or GPUs).

Reinders-KNL-Chapter24
Source: “Intel Xeon Phi Processor High Performance Programming, Knights Landing Edition,” 2016; used with permission – click to enlarge

The same holds true for visualization applications – Knights Landing provides a new level of flexibility for these kinds of highly specialized, data intensive workloads. Many people are surprised that Knights Landing can consistently beat the leading GPUs in visualization benchmarks 1 . But this is really not surprising when you consider that a GPU has a hard coded graphics pipeline, which is quite inflexible. Knights Landing, being a processor, has none of those constraints. Plus, you don’t wind up shipping massive amounts of data across the PCIe bus; the data is stored in on-package memory and is available for immediate processing.

Moving Toward Exascale

I think we can safely predict a long and happy life for the evolving Intel Xeon Phi processor family, which includes Knights Landing and all its descendants. Odds are that these next generation processors will play a major role in meeting one of HPC’s most exciting grand challenges – the realization of exascale.

Los Alamos National Laboratory’s Trinity supercomputer and the Cori supercomputer from NERSC are pre-exascale systems that will be operational in 2016. Both are powered by Knights Landing and are proof that double-digit petascale performance and the development of exascale machines are attainable without the use of attached accelerators or coprocessors.

And that’s why we emphasize that Knights Landing is a processor – a full-featured, extraordinarily powerful, highly parallel CPU – not a coprocessor or accelerator. It’s a major milestone on the road to exascale and an exciting new era in the world of high performance computing.

1 Intel Xeon Phi Processor High Performance Programming Knights Landing Edition, chapter 17, Software-defined Visualization

2 Intel Xeon Phi Processor High Performance Programming Knights Landing Edition, chapter 24, Machine Learning

All figures are reproduced with permission from Intel Xeon Phi Processor High Performance Programming, Knights Landing Edition by James Reinders, Jim Jeffers and Avinash Sodani, copyright 2016, published by Morgan Kaufmann, ISBN 978-0-12-809194-4. Figures are available for download at http://lotsofcores.com/KNLbook.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

NIST/Xanadu Researchers Report Photonic Quantum Computing Advance

March 3, 2021

Researchers from the National Institute of Standards and Technology (NIST) and Xanadu, a young Canada-based quantum computing company, have reported developing a full-stack, photonic quantum computer able to carry out th Read more…

By John Russell

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and even to this day, the largest climate models are heavily con Read more…

By Oliver Peckham

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2020) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective immediately. Hotard replaces long-time Cray exec Pete Ungaro Read more…

By Tiffany Trader

ORNL’s Jeffrey Vetter on How IRIS Runtime will Help Deal with Extreme Heterogeneity

March 2, 2021

Jeffery Vetter is a familiar figure in HPC. Last year he became one of the new section heads in a reorganization at Oak Ridge National Laboratory. He had been founding director of ORNL's Future Technologies Group which i Read more…

By John Russell

HPC Career Notes: March 2021 Edition

March 1, 2021

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it’s a promotion, new company hire, or even an accolade, we’ Read more…

By Mariana Iriarte

AWS Solution Channel

Moderna Accelerates COVID-19 Vaccine Development on AWS

Marcello Damiani, Chief Digital and Operational Excellence Officer at Moderna, joins Todd Weatherby, Vice President of AWS Professional Services Worldwide, for a discussion on developing Moderna’s COVID-19 vaccine, scaling systems to enable global distribution, and leveraging cloud technologies to accelerate processes. Read more…

Supercomputers Enable First Holistic Model of SARS-CoV-2, Showing Spike Proteins Move in Tandem

February 28, 2021

Most models of SARS-CoV-2, the coronavirus that causes COVID-19, hone in on key features of the virus: for instance, the spike protein. Some of this is attributable to the relative importance of those features, but most Read more…

By Oliver Peckham

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

By Oliver Peckham

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2020) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

By Tiffany Trader

ORNL’s Jeffrey Vetter on How IRIS Runtime will Help Deal with Extreme Heterogeneity

March 2, 2021

Jeffery Vetter is a familiar figure in HPC. Last year he became one of the new section heads in a reorganization at Oak Ridge National Laboratory. He had been f Read more…

By John Russell

HPC Career Notes: March 2021 Edition

March 1, 2021

In this monthly feature, we’ll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it Read more…

By Mariana Iriarte

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

By Oliver Peckham

Japan to Debut Integrated Fujitsu HPC/AI Supercomputer This Spring

February 25, 2021

The integrated Fujitsu HPC/AI Supercomputer, Wisteria, is coming to Japan this spring. The University of Tokyo is preparing to deploy a heterogeneous computing Read more…

By Tiffany Trader

Xilinx Launches Alveo SN1000 SmartNIC

February 24, 2021

FPGA vendor Xilinx has debuted its latest SmartNIC model, the Alveo SN1000, with integrated “composability” features that allow enterprise users to add their own custom networking functions to supplement its built-in networking. By providing deep flexibility... Read more…

By Todd R. Weiss

ASF Keynotes Showcase How HPC and Big Data Have Pervaded the Pandemic

February 24, 2021

Last Thursday, a range of experts joined the Advanced Scale Forum (ASF) in a rapid-fire roundtable to discuss how advanced technologies have transformed the way humanity responded to the COVID-19 pandemic in indelible ways. The roundtable, held near the one-year mark of the first... Read more…

By Oliver Peckham

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

By John Russell

Esperanto Unveils ML Chip with Nearly 1,100 RISC-V Cores

December 8, 2020

At the RISC-V Summit today, Art Swift, CEO of Esperanto Technologies, announced a new, RISC-V based chip aimed at machine learning and containing nearly 1,100 low-power cores based on the open-source RISC-V architecture. Esperanto Technologies, headquartered in... Read more…

By Oliver Peckham

Azure Scaled to Record 86,400 Cores for Molecular Dynamics

November 20, 2020

A new record for HPC scaling on the public cloud has been achieved on Microsoft Azure. Led by Dr. Jer-Ming Chia, the cloud provider partnered with the Beckman I Read more…

By Oliver Peckham

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

By Tracey Bryant

NICS Unleashes ‘Kraken’ Supercomputer

April 4, 2008

A Cray XT4 supercomputer, dubbed Kraken, is scheduled to come online in mid-summer at the National Institute for Computational Sciences (NICS). The soon-to-be petascale system, and the resulting NICS organization, are the result of an NSF Track II award of $65 million to the University of Tennessee and its partners to provide next-generation supercomputing for the nation's science community. Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Top500: Fugaku Keeps Crown, Nvidia’s Selene Climbs to #5

November 16, 2020

With the publication of the 56th Top500 list today from SC20's virtual proceedings, Japan's Fugaku supercomputer – now fully deployed – notches another win, Read more…

By Tiffany Trader

Gordon Bell Special Prize Goes to Massive SARS-CoV-2 Simulations

November 19, 2020

2020 has proven a harrowing year – but it has produced remarkable heroes. To that end, this year, the Association for Computing Machinery (ACM) introduced the Read more…

By Oliver Peckham

Leading Solution Providers

Contributors

Texas A&M Announces Flagship ‘Grace’ Supercomputer

November 9, 2020

Texas A&M University has announced its next flagship system: Grace. The new supercomputer, named for legendary programming pioneer Grace Hopper, is replacing the Ada system (itself named for mathematician Ada Lovelace) as the primary workhorse for Texas A&M’s High Performance Research Computing (HPRC). Read more…

By Oliver Peckham

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

By Oliver Peckham

Intel Xe-HP GPU Deployed for Aurora Exascale Development

November 17, 2020

At SC20, Intel announced that it is making its Xe-HP high performance discrete GPUs available to early access developers. Notably, the new chips have been deplo Read more…

By Tiffany Trader

Intel Teases Ice Lake-SP, Shows Competitive Benchmarking

November 17, 2020

At SC20 this week, Intel teased its forthcoming third-generation Xeon "Ice Lake-SP" server processor, claiming competitive benchmarking results against AMD's second-generation Epyc "Rome" processor. Ice Lake-SP, Intel's first server processor with 10nm technology... Read more…

By Tiffany Trader

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

By John Russell

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

By Tiffany Trader

It’s Fugaku vs. COVID-19: How the World’s Top Supercomputer Is Shaping Our New Normal

November 9, 2020

Fugaku is currently the most powerful publicly ranked supercomputer in the world – but we weren’t supposed to have it yet. The supercomputer, situated at Japan’s Riken scientific research institute, was scheduled to come online in 2021. When the pandemic struck... Read more…

By Oliver Peckham

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

By Oliver Peckham

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire