Intel’s SC16 Barrage Includes AI, Broadwell, Lustre and More

By John Russell

November 15, 2016

Intel made a flurry of announcements at SC16 today. Artificial intelligence figured prominently with new offerings and portfolio details. (Intel held back some news for an AI day planned this Thursday in San Francisco.) There was a fair amount of strutting for Xeon Phi’s (Knights landing) and OmniPath’s (OPA) strong showing in the TOP500. A new Broadwell chip was announced. So was the Intel HPC Orchestrator, a proprietary version of the open source HPC software stack from OpenHPC, the Linux Foundation project that Intel helped launch at SC15.

In the pre-briefing press call last week, Charlie Wuischpard, vice president, Scalable Data Center Solutions Group, warned those on the line there was a fair amount of material to cover. Here are a few highlights:

  • Knights Landing. The latest Intel Xeon Phi processor was in nine new systems on the TOP500, including two systems in the top 10, with the Cori system ranking fifth and Oakforest-PAC system ranking sixth. Additionally, Intel was the prime contractor supporting the Collaboration of Oak Ridge, Argonne and Lawrence Livermore (CORAL) in a top 20 system, the Argonne Theta system. (For more coverage see HPCwire article, US, China Vie for Supercomputing Supremacy.)
  • OmniPath. Shipping for just nine months, Intel’s 100GB Omni-Path Architecture was deployed in 28 of the top 500 and “now has 66 percent of the 100GB marketaccording to Intel. TOP500 designs include Oakforest-PACS, MIT Lincoln Lab and CINECA. Intel says OPA is double “the number of InfiniBand EDR systems and now accounts for around 66 percent of all 100GB systems.”
  • Artificial Intelligence. Intel debuted a Deep Learning Inference Accelerator card; it’s a field-programmable gate array (FPGA)-based hardware and software solution for neural network acceleration. It has an Arria 10 FPGA optimized for targeted topologies of convolutional neural networks and will be available in 2017.
  • intel-broadwell-sc16Broadwell. Intel introduced new Xeon processor E5-2699A v4 which becomes its fastest two-socket processor. The company cited the addition of the new top sku in the product line as evidence of its commitment to Broadwell.

Launch of the Intel HPC Orchestrator was not unexpected. Intel, of course, was a driving force behind creation of OpenHPC, which was formalized as a Linux Foundation Open Collaborative Project in June and introduced its first 1.1. version then. The straightforward idea is that providing an open source HPC software stack and associated tools will ease HPC deployment, particularly in the enterprise.

There were early concerns over Intel’s prominent role, and IBM has declined to join, but the stamp of Linux Foundation has eased worries somewhat. ARM is an enthusiastic member and has announced it would be supported in OpenHPC v 1.2.0.

OpenHPC says there have been roughly 200K downloads and 30K website visits to date. (See HPCwire articles, ARM Will Be Part of OpenHPC 1.2 Release at SC16; OpenHPC Pushes to Prove its Openness and Value at SC16.)

The Intel HPC Orchestrator is essentially a supported version of the OpenHPC stack with a few Intel optimizations and tools (see figure). For example, Intel has validated configurations for Xeon Phi and OmiPath. Cluster checker, formally part of the Intel cluster readiness product, is now included in Intel HPC Orchestrator as is Intel Lustre Enterprise edition. Wuischpard said Lustre’s use in nine of the top ten supercomputer demonstrates its traction and noted Seagate has struck a deal to adopt Intel Lustre Enterprise Edition over its own version.

intel-hpc-orchestrator

There are open source elements in Intel’s offering. “People may have a scheduler of choice and they have the ability to plug in a scheduler, so it (Intel HPC Orchestrator) is not completely hardened into a one solid piece,” said Wuischpard. “You can expect to see more from us around the software stack and software enablement in terms of not just delivering systems at these scales but particularly for work were doing at the top end of the supercomputing world.”

The AI announcements were among the more interesting. Indeed at SC16 this year, many technology vendors have pivoted to so-called AI as the clarion call. Barry Davis, GM, Intel’s Accelerated Workload Group, said Intel’s approach to AI is a departure from its past practice. “We are working on providing all the tools necessary to OEMs and end user customers to actually implement an AI solution,” he said (see figure below).

“We’ve augmented our data analytics acceleration library. We’ve also brought out Intel distributions for Python, which is a growing language for AI. Optimizing open frameworks is a huge area for us. One of the beauties of AI is most of the programming happens at a higher level on top of these open industry frameworks.”

At ISC, Intel introduced Intel Caffe and optimized one of the most popular AI frameworks in use today. “We are working on Spark, on Theano, Torch, etc., and we have one called the Neon framework which is actually part of our acquisition of Nervana which happened several months ago,” Davis said. Nervana, of course, is essentially full AI development platform.

intel-ai-portfolio

Intel plans to eventually offer AI solution blueprints, “We don’t have anything to talk about these right now but are working on reference platforms across many different industries once again focused on AI workloads.”

He briefly touched on Knights Mill, Intel’s first AI specific product first discussed back in August. “It is a variation of KNL and once again more to be said on 11/17, but what we are saying here is that it is a host CPU, bootable processor, with mixed precision performance for machine learning. What that means is we’ve augmented our capabilities for double precision with high performance single precision and other reduced precision formats for AI space,” he said.

The new Deep Learning Inference Accelerator, said Davis, has a full set of convolutional neural algorithms commonly used in things like image detection and fraud detection integrated that with all the libraries and other programming tools. He says it provides a four-fold performance per watt improvement over Xeon product.

Talking about the new Broadwell offering, Wuischpard said, “I know everyone’s familiar with the product Skylake, available next year, and many thought we weren’t going to be enhancing the current Broadwell or v4 line of products. There’s a couple of things to read in here. We continue to enhance the current product line. Every little bit of performance counts. And our customers are kind of driving us in that direction.

“The other notable thing is that it’s a good indication of the health of our 14 nanometer manufacturing process because as yields improve, as the manufacturing process improves, you can drive more performance out of the process. This is a good indication of that. So if you think of Skylake being on the same manufacturing process I think it’s a real promise in terms of what you can expect.”

Perhaps worth mentioning is Wuischpard’s assertion of Intel’s commitment to HPC and the developer ecosystem around it. “[In] the code modernization program, to date we’ve actually touched 2.5 million developers, trained 400,000 directly, 200,000 indirectly, and the number is growing,” said Wuischpard.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

GTC 2019: Chief Scientist Bill Dally Provides Glimpse into Nvidia Research Engine

March 22, 2019

Amid the frenzy of GTC this week – Nvidia’s annual conference showcasing all things GPU (and now AI) – William Dally, chief scientist and SVP of research, provided a brief but insightful portrait of Nvidia’s rese Read more…

By John Russell

ORNL Helps Identify Challenges of Extremely Heterogeneous Architectures

March 21, 2019

Exponential growth in classical computing over the last two decades has produced hardware and software that support lightning-fast processing speeds, but advancements are topping out as computing architectures reach thei Read more…

By Laurie Varma

Interview with 2019 Person to Watch Jim Keller

March 21, 2019

On the heels of Intel's reaffirmation that it will deliver the first U.S. exascale computer in 2021, which will feature the company's new Intel Xe architecture, we bring you our interview with our 2019 Person to Watch Jim Keller, head of the Silicon Engineering Group at Intel. Read more…

By HPCwire Editorial Team

HPE Extreme Performance Solutions

HPE and Intel® Omni-Path Architecture: How to Power a Cloud

Learn how HPE and Intel® Omni-Path Architecture provide critical infrastructure for leading Nordic HPC provider’s HPCFLOW cloud service.

powercloud_blog.jpgFor decades, HPE has been at the forefront of high-performance computing, and we’ve powered some of the fastest and most robust supercomputers in the world. Read more…

IBM Accelerated Insights

Insurance: Where’s the Risk?

Insurers are facing extreme competitive challenges in their core businesses. Property and Casualty (P&C) and Life and Health (L&H) firms alike are highly impacted by the ongoing globalization, increasing regulation, and digital transformation of their client bases. Read more…

What’s New in HPC Research: TensorFlow, Buddy Compression, Intel Optane & More

March 20, 2019

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

GTC 2019: Chief Scientist Bill Dally Provides Glimpse into Nvidia Research Engine

March 22, 2019

Amid the frenzy of GTC this week – Nvidia’s annual conference showcasing all things GPU (and now AI) – William Dally, chief scientist and SVP of research, Read more…

By John Russell

At GTC: Nvidia Expands Scope of Its AI and Datacenter Ecosystem

March 19, 2019

In the high-stakes race to provide the AI life-cycle solution of choice, three of the biggest horses in the field are IBM, Intel and Nvidia. While the latter is only a fraction of the size of its two bigger rivals, and has been in business for only a fraction of the time, Nvidia continues to impress with an expanding array of new GPU-based hardware, software, robotics, partnerships and... Read more…

By Doug Black

Nvidia Debuts Clara AI Toolkit with Pre-Trained Models for Radiology Use

March 19, 2019

AI’s push into healthcare got a boost yesterday with Nvidia’s release of the Clara Deploy AI toolkit which includes 13 pre-trained models for use in radiolo Read more…

By John Russell

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Oil and Gas Supercloud Clears Out Remaining Knights Landing Inventory: All 38,000 Wafers

March 13, 2019

The McCloud HPC service being built by Australia’s DownUnder GeoSolutions (DUG) outside Houston is set to become the largest oil and gas cloud in the world th Read more…

By Tiffany Trader

Quick Take: Trump’s 2020 Budget Spares DoE-funded HPC but Slams NSF and NIH

March 12, 2019

U.S. President Donald Trump’s 2020 budget request, released yesterday, proposes deep cuts in many science programs but seems to spare HPC funding by the Depar Read more…

By John Russell

Nvidia Wins Mellanox Stakes for $6.9 Billion

March 11, 2019

The long-rumored acquisition of Mellanox came to fruition this morning with GPU chipmaker Nvidia’s announcement that it has purchased the high-performance net Read more…

By Doug Black

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Arm Unveils Neoverse N1 Platform with up to 128-Cores

February 20, 2019

Following on its Neoverse roadmap announcement last October, Arm today revealed its next-gen Neoverse microarchitecture with compute and throughput-optimized si Read more…

By Tiffany Trader

France to Deploy AI-Focused Supercomputer: Jean Zay

January 22, 2019

HPE announced today that it won the contract to build a supercomputer that will drive France’s AI and HPC efforts. The computer will be part of GENCI, the Fre Read more…

By Tiffany Trader

Move Over Lustre & Spectrum Scale – Here Comes BeeGFS?

November 26, 2018

Is BeeGFS – the parallel file system with European roots – on a path to compete with Lustre and Spectrum Scale worldwide in HPC environments? Frank Herold Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This