Momentum Builds for Intel’s HPC Scalable System Framework

By Tiffany Trader

July 13, 2015

At a press conference on Friday, Intel delivered a progress report on the state of its unfolding HPC portfolio. With key products like Omni-Path and Knights Landing set to launch later this year, Intel is focusing on the momentum that is building for its HPC Scalable System Framework. The company also announced that it is entering into a deeper alliance with system partner HP to support HPC at a full range of scales.

Intel sees the framework as a configurable design path that is customizable for a wide range of workloads. The framework combines compute (Xeon and Phi processors), fabric, silicon photonics, innovative memory technologies, and the Intel Lustre parallel file system, plus the ability to efficiently integrate these elements into a broad spectrum of system solutions, optimized for both compute- and data-intensive workloads.

Intel HPC Scalable System Framework ISC 2015 slide

“It’s an organizing principle for us and for our OEM partners,” said Charlie Wuischpard, vice president of Intel’s data center group and general manager. “Rather than just building a big one-off system it’s really to take those learnings and that technology to make sure it’s usable across the entire industry and that it can be dialed-in to cover both compute and data-centric workloads.”

“From a half rack, full rack, row, up to the largest supercomputer in the world, this technology should be usable and productive,” he added. “And it’s all based on standards-based programmability on the x86 ISA, and can handle different business models from on-premise to cloud.”

A bolstered alliance between Intel and HP illustrates how the Scalable System Framework is being used by the industry. Under the renewed partnership, covered in greater detail here, HP is building a set of industry and workload optimized solutions on top of the Intel framework. The agreement is essentially a merging of Intel and HP innovation with a strong focus on code modernization and rapid deployment that will be facilitated via a new Center of Excellence in Houston, Texas. Intel has a similar partnership in place with Cray, which in April announced that it is basing its future Shasta architecture on the Intel framework.

Although these are the only renewed partnerships that have been revealed so far, the system framework is an essential part of Intel’s strategy and the company sees opportunities for all its partners to provide differentiation on top of this framework with regard to their respective markets and customers.

Diving into some of the building blocks for this framework, Intel is putting the spotlight on its Omni-Path fabric, which is gearing up to hit its official general availability launch date later this year. Wuischpard said Intel has already won quite a few opportunities that it will be installing in Q4 of 2015, and it has been sampling with all the major HPC and OEM vendors. There is also a pipeline of opportunities that have been bid and priced, the VP noted. He added that Intel has been pleased with the health of the silicon and the progress that has been made from an engineering perspective. Some of the testing and performance has been “super encouraging,” according to Wuischpard, which is to say that while GA is still to come the firm is “essentially open for business and taking pre-orders.”

The other bit of information that Intel has let out about Omni-Path is that it will have single port adapter cards, plus a pair of edge switches for inside of racks or to be used as spines and a pair of director switches for aggregating across racks. The edge switches will come with 24 or 48 ports, and the director switches will come with 192 or 768 ports.

What most want to know is how Omni-Path will compare to InfiniBand, and particularly EDR InfiniBand. Wuischpard highlighted the high message rate, low latency and the benefit of strong resiliency that doesn’t introduce more latency. Other features include traffic flow optimization and dynamic lane scaling, and Intel’s commitment to “top to bottom product line coverage.” The chipmaker said it will be coming to market with single-port Host Fabric Adapter (PCIe) cards, 24- and 48-port edge switches to handle the low-to-mid range, and for very large systems, 192-port and 768-port (QSFP-based leaf switch) director switches.

Intel Omni-Path 100 Series ISC 2015 slide cropped

 

“Whether you are a small half-rack or storage focused solution up through the very largest supercomputers, you now have a range of options and a range of price points to work with. In the aggregate, this will be the best TCO and the best ROI solution on the market in this time frame,” Wuischpard stated.

When it comes to the new Phi Knights Landing chips, Wuischpard said the company has been focusing on ecosystem readiness and sampling. As has been previously mentioned in other reports, the SKUs will be up to 72 cores with 2 vector processing units per core. Intel expects to have more than 50 systems providers at general availability with first systems shipping by year’s end. The firm is also putting a lot of effort into the software development kits, something that Wuischpard acknowledged may not have had enough attention for the Knights Corner release. The aim is for the product to be easy to use out of the box, and intuitive. “[We are creating] the iPhone experience for Knights Landing, with scripts, sample codes and the like,” said Wuischpard.

Intel Lustre-based solutions were also covered in the briefing. The business that Intel acquired, formerly known as Whamcloud, was first resident in Intel’s software division. Two months ago, based on the concern that it wasn’t fully being leveraged, Lustre was moved over into the datacenter group. Intel says it is increasing its investment in Lustre, and its has a roadmap for the next two editions as well as a cloud edition with additional features being announced over the next six months. “More than anything we want to be able to make the product easy to use, more enterprise-ready and at the same time build the features that allow you to do extreme-scale I/O,” the VP stated.

Intel Lustre roadmap ISC 2015 slide

Another effort that Intel previewed is the extension of its Intel Cluster Ready program to develop a product built from open source components that will have free and for-fee versions. Intel says its primary goal is to enable a high quality solution at all scales by providing an appliance-like experience targeting smaller or commercial industry sites to support easier HPC stack building and testing.

Intel is also heavily invested in code modernization through its Intel Parallel Computing Centers. To date, Intel has 50 centers around the world including one recently opened in China. In line with this mission, Intel is creating an online community to reach approximately 400,000 developers and partners with tools, trainings and support by the end of the year. Wuischpard observed that when Intel pairs its “Black Belts in parallelism from inside Intel and industry” with subject matter experts to work on specific codes they achieve great results, so Intel is in the process of hiring more Black Belts and formalizing this process to scale coding skills broadly. The firm will also be doing Hackathon-like events with prizes to stimulate more interest.

An expanded HPC Developer Conference, where developers share proven techniques and best practices, is in the works for the US, Asia and Europe. A one-day session held the Sunday before Supercomputing last November drew more than 500 attendees, and Intel expects future events will draw many times this number. The company is also working to cultivate additional Intel code modernization partners. The program is aiming to train 10,000 developers and partners with remote access to Intel clusters and hardware.

For those attending ISC in Frankfurt, Germany, this week, Knights Landing and Omni-Path will be on display at Intel’s booth.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Pfizer HPC Engineer Aims to Automate Software Stack Testing

January 17, 2019

Seeking to reign in the tediousness of manual software testing, Pfizer HPC Engineer Shahzeb Siddiqui is developing an open source software tool called buildtest, aimed at automating software stack testing by providing the community with a central repository of tests for common HPC apps and the ability to automate execution of testing. Read more…

By Tiffany Trader

Senegal Prepares to Take Delivery of Atos Supercomputer

January 16, 2019

In just a few months time, Senegal will be operating the second largest HPC system in sub-Saharan Africa. The Minister of Higher Education, Research and Innovation Mary Teuw Niane made the announcement on Monday (Jan. 14 Read more…

By Tiffany Trader

Google Cloud Platform Extends GPU Instance Options

January 16, 2019

If it's Nvidia GPUs you're after to power your AI/HPC/visualization workload, Google Cloud has them, now claiming "broadest GPU availability." Each of the three big public cloud vendors has by turn touted the latest and Read more…

By Tiffany Trader

HPE Extreme Performance Solutions

HPE Systems With Intel Omni-Path: Architected for Value and Accessible High-Performance Computing

Today’s high-performance computing (HPC) and artificial intelligence (AI) users value high performing clusters. And the higher the performance that their system can deliver, the better. Read more…

IBM Accelerated Insights

Resource Management in the Age of Artificial Intelligence

New challenges demand fresh approaches

Fueled by GPUs, big data, and rapid advances in software, the AI revolution is upon us. Read more…

STAC Floats ML Benchmark for Financial Services Workloads

January 16, 2019

STAC (Securities Technology Analysis Center) recently released an ‘exploratory’ benchmark for machine learning which it hopes will evolve into a firm benchmark or suite of benchmarking tools to compare the performanc Read more…

By John Russell

Google Cloud Platform Extends GPU Instance Options

January 16, 2019

If it's Nvidia GPUs you're after to power your AI/HPC/visualization workload, Google Cloud has them, now claiming "broadest GPU availability." Each of the three Read more…

By Tiffany Trader

STAC Floats ML Benchmark for Financial Services Workloads

January 16, 2019

STAC (Securities Technology Analysis Center) recently released an ‘exploratory’ benchmark for machine learning which it hopes will evolve into a firm benchm Read more…

By John Russell

A Big Data Journey While Seeking to Catalog our Universe

January 16, 2019

It turns out, astronomers have lots of photos of the sky but seek knowledge about what the photos mean. Sound familiar? Big data problems are often characterize Read more…

By James Reinders

Intel Bets Big on 2-Track Quantum Strategy

January 15, 2019

Quantum computing has lived so long in the future it’s taken on a futuristic life of its own, with a Gartner-style hype cycle that includes triggers of innovation, inflated expectations and – though a useful quantum system is still years away – anticipatory troughs of disillusionment. Read more…

By Doug Black

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

IBM’s New Global Weather Forecasting System Runs on GPUs

January 9, 2019

Anyone who has checked a forecast to decide whether or not to pack an umbrella knows that weather prediction can be a mercurial endeavor. It is a Herculean task: the constant modeling of incredibly complex systems to a high degree of accuracy at a local level within very short spans of time. Read more…

By Oliver Peckham

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

Cray Unveils Shasta, Lands NERSC-9 Contract

October 30, 2018

Cray revealed today the details of its next-gen supercomputing architecture, Shasta, selected to be the next flagship system at NERSC. We've known of the code-name "Shasta" since the Argonne slice of the CORAL project was announced in 2015 and although the details of that plan have changed considerably, Cray didn't slow down its timeline for Shasta. Read more…

By Tiffany Trader

AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

US Leads Supercomputing with #1, #2 Systems & Petascale Arm

November 12, 2018

The 31st Supercomputing Conference (SC) - commemorating 30 years since the first Supercomputing in 1988 - kicked off in Dallas yesterday, taking over the Kay Ba Read more…

By Tiffany Trader

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

Nvidia’s Jensen Huang Delivers Vision for the New HPC

November 14, 2018

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

HPE No. 1, IBM Surges, in ‘Bucking Bronco’ High Performance Server Market

September 27, 2018

Riding healthy U.S. and global economies, strong demand for AI-capable hardware and other tailwind trends, the high performance computing server market jumped 28 percent in the second quarter 2018 to $3.7 billion, up from $2.9 billion for the same period last year, according to industry analyst firm Hyperion Research. Read more…

By Doug Black

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Intel Confirms 48-Core Cascade Lake-AP for 2019

November 4, 2018

As part of the run-up to SC18, taking place in Dallas next week (Nov. 11-16), Intel is doling out info on its next-gen Cascade Lake family of Xeon processors, specifically the “Advanced Processor” version (Cascade Lake-AP), architected for high-performance computing, artificial intelligence and infrastructure-as-a-service workloads. Read more…

By Tiffany Trader

Germany Celebrates Launch of Two Fastest Supercomputers

September 26, 2018

The new high-performance computer SuperMUC-NG at the Leibniz Supercomputing Center (LRZ) in Garching is the fastest computer in Germany and one of the fastest i Read more…

By Tiffany Trader

Houston to Field Massive, ‘Geophysically Configured’ Cloud Supercomputer

October 11, 2018

Based on some news stories out today, one might get the impression that the next system to crack number one on the Top500 would be an industrial oil and gas mon Read more…

By Tiffany Trader

Microsoft to Buy Mellanox?

December 20, 2018

Networking equipment powerhouse Mellanox could be an acquisition target by Microsoft, according to a published report in an Israeli financial publication. Microsoft has reportedly gone so far as to engage Goldman Sachs to handle negotiations with Mellanox. Read more…

By Doug Black

House Passes $1.275B National Quantum Initiative

September 17, 2018

Last Thursday the U.S. House of Representatives passed the National Quantum Initiative Act (NQIA) intended to accelerate quantum computing research and developm Read more…

By John Russell

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This