Momentum Builds for Intel’s HPC Scalable System Framework

By Tiffany Trader

July 13, 2015

At a press conference on Friday, Intel delivered a progress report on the state of its unfolding HPC portfolio. With key products like Omni-Path and Knights Landing set to launch later this year, Intel is focusing on the momentum that is building for its HPC Scalable System Framework. The company also announced that it is entering into a deeper alliance with system partner HP to support HPC at a full range of scales.

Intel sees the framework as a configurable design path that is customizable for a wide range of workloads. The framework combines compute (Xeon and Phi processors), fabric, silicon photonics, innovative memory technologies, and the Intel Lustre parallel file system, plus the ability to efficiently integrate these elements into a broad spectrum of system solutions, optimized for both compute- and data-intensive workloads.

Intel HPC Scalable System Framework ISC 2015 slide

“It’s an organizing principle for us and for our OEM partners,” said Charlie Wuischpard, vice president of Intel’s data center group and general manager. “Rather than just building a big one-off system it’s really to take those learnings and that technology to make sure it’s usable across the entire industry and that it can be dialed-in to cover both compute and data-centric workloads.”

“From a half rack, full rack, row, up to the largest supercomputer in the world, this technology should be usable and productive,” he added. “And it’s all based on standards-based programmability on the x86 ISA, and can handle different business models from on-premise to cloud.”

A bolstered alliance between Intel and HP illustrates how the Scalable System Framework is being used by the industry. Under the renewed partnership, covered in greater detail here, HP is building a set of industry and workload optimized solutions on top of the Intel framework. The agreement is essentially a merging of Intel and HP innovation with a strong focus on code modernization and rapid deployment that will be facilitated via a new Center of Excellence in Houston, Texas. Intel has a similar partnership in place with Cray, which in April announced that it is basing its future Shasta architecture on the Intel framework.

Although these are the only renewed partnerships that have been revealed so far, the system framework is an essential part of Intel’s strategy and the company sees opportunities for all its partners to provide differentiation on top of this framework with regard to their respective markets and customers.

Diving into some of the building blocks for this framework, Intel is putting the spotlight on its Omni-Path fabric, which is gearing up to hit its official general availability launch date later this year. Wuischpard said Intel has already won quite a few opportunities that it will be installing in Q4 of 2015, and it has been sampling with all the major HPC and OEM vendors. There is also a pipeline of opportunities that have been bid and priced, the VP noted. He added that Intel has been pleased with the health of the silicon and the progress that has been made from an engineering perspective. Some of the testing and performance has been “super encouraging,” according to Wuischpard, which is to say that while GA is still to come the firm is “essentially open for business and taking pre-orders.”

The other bit of information that Intel has let out about Omni-Path is that it will have single port adapter cards, plus a pair of edge switches for inside of racks or to be used as spines and a pair of director switches for aggregating across racks. The edge switches will come with 24 or 48 ports, and the director switches will come with 192 or 768 ports.

What most want to know is how Omni-Path will compare to InfiniBand, and particularly EDR InfiniBand. Wuischpard highlighted the high message rate, low latency and the benefit of strong resiliency that doesn’t introduce more latency. Other features include traffic flow optimization and dynamic lane scaling, and Intel’s commitment to “top to bottom product line coverage.” The chipmaker said it will be coming to market with single-port Host Fabric Adapter (PCIe) cards, 24- and 48-port edge switches to handle the low-to-mid range, and for very large systems, 192-port and 768-port (QSFP-based leaf switch) director switches.

Intel Omni-Path 100 Series ISC 2015 slide cropped

 

“Whether you are a small half-rack or storage focused solution up through the very largest supercomputers, you now have a range of options and a range of price points to work with. In the aggregate, this will be the best TCO and the best ROI solution on the market in this time frame,” Wuischpard stated.

When it comes to the new Phi Knights Landing chips, Wuischpard said the company has been focusing on ecosystem readiness and sampling. As has been previously mentioned in other reports, the SKUs will be up to 72 cores with 2 vector processing units per core. Intel expects to have more than 50 systems providers at general availability with first systems shipping by year’s end. The firm is also putting a lot of effort into the software development kits, something that Wuischpard acknowledged may not have had enough attention for the Knights Corner release. The aim is for the product to be easy to use out of the box, and intuitive. “[We are creating] the iPhone experience for Knights Landing, with scripts, sample codes and the like,” said Wuischpard.

Intel Lustre-based solutions were also covered in the briefing. The business that Intel acquired, formerly known as Whamcloud, was first resident in Intel’s software division. Two months ago, based on the concern that it wasn’t fully being leveraged, Lustre was moved over into the datacenter group. Intel says it is increasing its investment in Lustre, and its has a roadmap for the next two editions as well as a cloud edition with additional features being announced over the next six months. “More than anything we want to be able to make the product easy to use, more enterprise-ready and at the same time build the features that allow you to do extreme-scale I/O,” the VP stated.

Intel Lustre roadmap ISC 2015 slide

Another effort that Intel previewed is the extension of its Intel Cluster Ready program to develop a product built from open source components that will have free and for-fee versions. Intel says its primary goal is to enable a high quality solution at all scales by providing an appliance-like experience targeting smaller or commercial industry sites to support easier HPC stack building and testing.

Intel is also heavily invested in code modernization through its Intel Parallel Computing Centers. To date, Intel has 50 centers around the world including one recently opened in China. In line with this mission, Intel is creating an online community to reach approximately 400,000 developers and partners with tools, trainings and support by the end of the year. Wuischpard observed that when Intel pairs its “Black Belts in parallelism from inside Intel and industry” with subject matter experts to work on specific codes they achieve great results, so Intel is in the process of hiring more Black Belts and formalizing this process to scale coding skills broadly. The firm will also be doing Hackathon-like events with prizes to stimulate more interest.

An expanded HPC Developer Conference, where developers share proven techniques and best practices, is in the works for the US, Asia and Europe. A one-day session held the Sunday before Supercomputing last November drew more than 500 attendees, and Intel expects future events will draw many times this number. The company is also working to cultivate additional Intel code modernization partners. The program is aiming to train 10,000 developers and partners with remote access to Intel clusters and hardware.

For those attending ISC in Frankfurt, Germany, this week, Knights Landing and Omni-Path will be on display at Intel’s booth.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

GTC 2019: Chief Scientist Bill Dally Provides Glimpse into Nvidia Research Engine

March 22, 2019

Amid the frenzy of GTC this week – Nvidia’s annual conference showcasing all things GPU (and now AI) – William Dally, chief scientist and SVP of research, provided a brief but insightful portrait of Nvidia’s rese Read more…

By John Russell

ORNL Helps Identify Challenges of Extremely Heterogeneous Architectures

March 21, 2019

Exponential growth in classical computing over the last two decades has produced hardware and software that support lightning-fast processing speeds, but advancements are topping out as computing architectures reach thei Read more…

By Laurie Varma

Interview with 2019 Person to Watch Jim Keller

March 21, 2019

On the heels of Intel's reaffirmation that it will deliver the first U.S. exascale computer in 2021, which will feature the company's new Intel Xe architecture, we bring you our interview with our 2019 Person to Watch Jim Keller, head of the Silicon Engineering Group at Intel. Read more…

By HPCwire Editorial Team

HPE Extreme Performance Solutions

HPE and Intel® Omni-Path Architecture: How to Power a Cloud

Learn how HPE and Intel® Omni-Path Architecture provide critical infrastructure for leading Nordic HPC provider’s HPCFLOW cloud service.

powercloud_blog.jpgFor decades, HPE has been at the forefront of high-performance computing, and we’ve powered some of the fastest and most robust supercomputers in the world. Read more…

IBM Accelerated Insights

Insurance: Where’s the Risk?

Insurers are facing extreme competitive challenges in their core businesses. Property and Casualty (P&C) and Life and Health (L&H) firms alike are highly impacted by the ongoing globalization, increasing regulation, and digital transformation of their client bases. Read more…

What’s New in HPC Research: TensorFlow, Buddy Compression, Intel Optane & More

March 20, 2019

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

GTC 2019: Chief Scientist Bill Dally Provides Glimpse into Nvidia Research Engine

March 22, 2019

Amid the frenzy of GTC this week – Nvidia’s annual conference showcasing all things GPU (and now AI) – William Dally, chief scientist and SVP of research, Read more…

By John Russell

At GTC: Nvidia Expands Scope of Its AI and Datacenter Ecosystem

March 19, 2019

In the high-stakes race to provide the AI life-cycle solution of choice, three of the biggest horses in the field are IBM, Intel and Nvidia. While the latter is only a fraction of the size of its two bigger rivals, and has been in business for only a fraction of the time, Nvidia continues to impress with an expanding array of new GPU-based hardware, software, robotics, partnerships and... Read more…

By Doug Black

Nvidia Debuts Clara AI Toolkit with Pre-Trained Models for Radiology Use

March 19, 2019

AI’s push into healthcare got a boost yesterday with Nvidia’s release of the Clara Deploy AI toolkit which includes 13 pre-trained models for use in radiolo Read more…

By John Russell

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Oil and Gas Supercloud Clears Out Remaining Knights Landing Inventory: All 38,000 Wafers

March 13, 2019

The McCloud HPC service being built by Australia’s DownUnder GeoSolutions (DUG) outside Houston is set to become the largest oil and gas cloud in the world th Read more…

By Tiffany Trader

Quick Take: Trump’s 2020 Budget Spares DoE-funded HPC but Slams NSF and NIH

March 12, 2019

U.S. President Donald Trump’s 2020 budget request, released yesterday, proposes deep cuts in many science programs but seems to spare HPC funding by the Depar Read more…

By John Russell

Nvidia Wins Mellanox Stakes for $6.9 Billion

March 11, 2019

The long-rumored acquisition of Mellanox came to fruition this morning with GPU chipmaker Nvidia’s announcement that it has purchased the high-performance net Read more…

By Doug Black

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

It’s Official: Aurora on Track to Be First US Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Arm Unveils Neoverse N1 Platform with up to 128-Cores

February 20, 2019

Following on its Neoverse roadmap announcement last October, Arm today revealed its next-gen Neoverse microarchitecture with compute and throughput-optimized si Read more…

By Tiffany Trader

France to Deploy AI-Focused Supercomputer: Jean Zay

January 22, 2019

HPE announced today that it won the contract to build a supercomputer that will drive France’s AI and HPC efforts. The computer will be part of GENCI, the Fre Read more…

By Tiffany Trader

Move Over Lustre & Spectrum Scale – Here Comes BeeGFS?

November 26, 2018

Is BeeGFS – the parallel file system with European roots – on a path to compete with Lustre and Spectrum Scale worldwide in HPC environments? Frank Herold Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This