Leveraging HPC Hardware to Run Next-generation Molecular Imaging Analysis

By Louis Vistola

October 6, 2016

Deriving the three-dimensional (3D) structure of biological macromolecules is critical to fighting cancer and other diseases. A deeper understanding of the structure can help researchers design inhibitors and develop new drugs to treat or cure patients.

While molecular imaging technology has improved over the years, the computational challenges have grown. Currently, cryo-electron microscopy (cryo-EM) is  rapidly replacing the traditional X-ray crystallography method for elucidating the 3D structures of single biomolecules in a state that is much closer to their native form. A better computational method is needed to extract the 3D structure from microscope’s two-dimensional (2D) images.

This is an area where Dr. Youdong (Jack) Mao has focused his energy. He is using Dell PowerEdge servers with new Intel® Xeon Phi™ processor (a.k.a. Knights Landing) technology to develop a high-performance computing (HPC) molecular imaging analysis platform. The work aims to take advantage of higher performance capabilities of today’s multicore, parallel processor architectures.

Why HPC is required

Like many aspects of modern life sciences research, the analysis of molecular imaging involves large volumes of data. Using cryo-EM, a sample under inspection might have 50,000 to 100,000 single particles in random orientations, generating a massive amount of molecular images. Analyzing these images to determine the 3D molecular structure can take one million CPU hours.

That’s for one molecule and one experimental run. A research facility with three to five microscopes can produce 25 terabytes of raw data per microscope per day, which after processing  results in a approximately 2 to 3 terabytes of data a day and somewhere in the petabyte range per  year.

A second factor that impacts HPC requirements is the noisy data. Because biomolecules are highly sensitive to radiation damage by the microscope’s electron beam, the molecular images have to be taken at a low dose. This gives rise to an extremely high degree of noise in the formation of the image. In fact, the signal to noise ratio is 10 to 100 times lower than normal imaging data. As a result, researchers must use sophisticated averaging and machine learning techniques to classify the image and analyze the 3D structure of a sample.

These issues have limited research in the field. The place to start to improve the situation was to update the analysis software. “The software has evolved from code developed decades ago,” said Dr. Mao. Most of the software was designed to run on a single core and does not take the hardware capabilities of the Intel® Xeon Phi processor into account.

Dr. Mao has had a multi-year collaboration with Dell and Intel at both the Intel® Parallel Computing Center (IPCC) at Dana-Farber Cancer Institute (DFCI) and at Peking University.  “We are trying to modernize the code,” said Dr. Mao. There are cases where the new code, leveraging multiple cores and hardware acceleration technology of the Intel chips, speeds up averaging by a factor of 1,000. “With the speed up, we can think about using more sophisticated software,” said Dr. Mao. For example, artificial intelligence and machine learning methods can be used.

“This opens up new frontiers,” said Dr. Mao. He notes that by harnessing the additional compute capacity, researchers can increase their image analysis throughput by an order of magnitude. Or they can choose to do a deeper analysis of their data. To that latter point, researchers can refine the classification of their images.

Looking to the future

The work in this area goes beyond simply updating old code. The ultimate goal is to develop a cutting-edge solution for the next-generation HPC platform for structural biology, based on Intel®Many Integrated Core Architecture and Intel® Scalable System Framework

Specifically, the research at IPCC at DFCI seeks to capitalize on the tremendous potential of Intel’s processor architecture in system design based on the Scalable System Framework, as well as heterogeneous parallel computing, to process a rapidly increasing volume of electron microscopy data.

One development from this work is the ROME (Refinement and Optimization via Machine lEarning for cryo-EM) software package. The open source ROME package is a parallel computing software system dedicated for high-resolution cryo-EM structure determination and data analysis, which implements advanced machine learning approaches in modern computer sciences and runs natively in an HPC environment. The ROME 1.0 introduces SML (statistical manifold learning)-based deep classification following MAP-based image alignment. It also implemented traditional unsupervised MAP-based classification and includes several useful tools, such as 2D class averaging with CTF (contrast transfer function) correction and a convenient GUI for curation, inspection, and verification of single-particle classes. The ROME system has been optimized on both Intel® Xeon multi-core CPUs and Intel® Xeon Phi many-core coprocessors.

Making use of Dell PowerEdge servers with the new generation of Intel® Xeon Phi processors, researchers have a powerful tool to expand their work in the life sciences. The platform can be used as a general resource for parallel computing applications in structural biology and molecular medicine. Specifically, the combination of Dell and Intel hardware with the optimized analysis software offers a system for the ultra-high-resolution reconstruction of single biomolecules in their native states.

For more information about accelerating life sciences research with new HPC platforms, visit www.dell.com/hpc

For more information on Code Modernization with the Life Sciences Community, visit www.intel.com/healthcare/optimizecode

For more information on Intel® Parallel Computer Center for Structural Biology at Dana Farber Cancer Institute and Harvard Medical School, visit http://ipccsb.dfci.harvard.edu/index.html

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Insights from Optimized Codes on Cineca’s Marconi

February 15, 2019

What can you do with 381,392 CPU cores? For Cineca, it means enabling computational scientists to expand a large part of the world’s body of knowledge from the nanoscale to the astronomic, from calculating quantum effe Read more…

By Ken Strandberg

What Will IBM’s AI Debater Learn from Its Loss?

February 14, 2019

The utility of IBM’s latest man-versus-machine gambit is debatable. At the very least its Project Debater got us thinking about the potential uses of artificial intelligence as a way of helping humans sift through al Read more…

By George Leopold

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst of bankruptcy proceedings. According to Dutch news site Drimb Read more…

By Tiffany Trader

HPE Extreme Performance Solutions

HPE Systems With Intel Omni-Path: Architected for Value and Accessible High-Performance Computing

Today’s high-performance computing (HPC) and artificial intelligence (AI) users value high performing clusters. And the higher the performance that their system can deliver, the better. Read more…

IBM Accelerated Insights

Medical Research Powered by Data

“We’re all the same, but we’re unique as well. In that uniqueness lies all of the answers….”

  • Mark Tykocinski, MD, Provost, Executive Vice President for Academic Affairs, Thomas Jefferson University

Getting the answers to what causes some people to develop diseases and not others is driving the groundbreaking medical research being conducted by the Computational Medicine Center at Thomas Jefferson University in Philadelphia. Read more…

South African Weather Service Doubles Compute and Triples Storage Capacity of Cray System

February 13, 2019

South Africa has made headlines in recent years for its commitment to HPC leadership in Africa – and now, Cray has announced another major South African HPC expansion. Cray has been awarded contracts with Eclipse Holdings Ltd. to upgrade the supercomputing system operated by the South African Weather Service (SAWS). Read more…

By Oliver Peckham

Insights from Optimized Codes on Cineca’s Marconi

February 15, 2019

What can you do with 381,392 CPU cores? For Cineca, it means enabling computational scientists to expand a large part of the world’s body of knowledge from th Read more…

By Ken Strandberg

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

UC Berkeley Paper Heralds Rise of Serverless Computing in the Cloud – Do You Agree?

February 13, 2019

Almost exactly ten years to the day from publishing of their widely-read, seminal paper on cloud computing, UC Berkeley researchers have issued another ambitious examination of cloud computing - Cloud Programming Simplified: A Berkeley View on Serverless Computing. The new work heralds the rise of ‘serverless computing’ as the next dominant phase of cloud computing. Read more…

By John Russell

Iowa ‘Grows Its Own’ to Fill the HPC Workforce Pipeline

February 13, 2019

The global workforce that supports advanced computing, scientific software and high-speed research networks is relatively small when you stop to consider the magnitude of the transformative discoveries it empowers. Technical conferences provide a forum where specialists convene to learn about the latest innovations and schedule face-time with colleagues from other institutions. Read more…

By Elizabeth Leake, STEM-Trek

Trump Signs Executive Order Launching U.S. AI Initiative

February 11, 2019

U.S. President Donald Trump issued an Executive Order (EO) today launching a U.S Artificial Intelligence Initiative. The new initiative - Maintaining American L Read more…

By John Russell

Celebrating Women in Science: Meet Four Women Leading the Way in HPC

February 11, 2019

One only needs to look around at virtually any CS/tech conference to realize that women are underrepresented, and that holds true of HPC. SC hosts over 13,000 H Read more…

By AJ Lauer

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

Assessing Government Shutdown’s Impact on HPC

February 6, 2019

After a 35-day federal government shutdown, the longest in U.S. history, government agencies are taking stock of the damage -- and girding for a potential secon Read more…

By Tiffany Trader

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

Cray Unveils Shasta, Lands NERSC-9 Contract

October 30, 2018

Cray revealed today the details of its next-gen supercomputing architecture, Shasta, selected to be the next flagship system at NERSC. We've known of the code-name "Shasta" since the Argonne slice of the CORAL project was announced in 2015 and although the details of that plan have changed considerably, Cray didn't slow down its timeline for Shasta. Read more…

By Tiffany Trader

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

US Leads Supercomputing with #1, #2 Systems & Petascale Arm

November 12, 2018

The 31st Supercomputing Conference (SC) - commemorating 30 years since the first Supercomputing in 1988 - kicked off in Dallas yesterday, taking over the Kay Ba Read more…

By Tiffany Trader

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

Nvidia’s Jensen Huang Delivers Vision for the New HPC

November 14, 2018

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

Intel Confirms 48-Core Cascade Lake-AP for 2019

November 4, 2018

As part of the run-up to SC18, taking place in Dallas next week (Nov. 11-16), Intel is doling out info on its next-gen Cascade Lake family of Xeon processors, specifically the “Advanced Processor” version (Cascade Lake-AP), architected for high-performance computing, artificial intelligence and infrastructure-as-a-service workloads. Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This