Inside ComPatAI, One of LUMI’s First Projects

By Oliver Peckham

June 8, 2023

About a year ago, the LUMI supercomputer – a EuroHPC system based at a CSC datacenter in Kajaani, Finland – debuted in third place on the Top500 list (a position it has maintained on the two subsequent lists). Around that time, CSC announced some of the first workloads that would be hosted on the massive supercomputer. We spoke with Pekka Ruusuvuori, head of the bioinformatics group at the University of Turku and PI of the ComPatAI project, about his team’s research on LUMI.

The research team has been using CSC’s supercomputers for some years: they were a pilot project on Puhti, LUMI’s predecessor, and even used Puhti’s predecessor – Taito – before that. With each new system, the training time – and the scale of training possible – has been whittled down.

But that’s getting ahead of things: first, what is ComPatAI? The name is short for “computational pathology AI,” which is the project in a nutshell.

Computational histopathology

“Basically, what we are doing with LUMI is to crunch the numbers with the digital pathology data,” Ruusuvuori told HPCwire, adding that “obviously, these days, it’s the artificial intelligence, deep learning-based approach that really enables” high-accuracy analysis. “We can reach a higher accuracy in almost any task where we have enough data compared to anything that has been available before,” Ruusuvuori said.

“What we are trying to do [is] we are trying to build this … general-purpose neural network for extracting features and understanding histological data,” Ruusuvuori explained. (Histology, for reference, is the study of biological tissues.)

In developing this general-purpose computational pathology neural network, Ruusuvuori said there were two main branches of their research. “One is to try to [automate] something that the pathologists are doing routinely at the clinic – so basically to determine whether the patient has a cancer or not,” he said. “And then, if he or she has a cancer, then to determine what is the aggressiveness; what is the grade of the cancer?” Ruusuvuori said that the hope was to provide resources to help experts “work less subjectively, more reliably and also faster with the help of an AI-based decision support tool.”

The other branch: trying to understand disease mechanisms on a deeper level, which – unlike the diagnosis – is not merely streamlining an existing process. Ruusuvuori said that the histopathological images show more information “than what the human eye can really comprehend,” explaining that in his team’s research, they are working to predict gene expression levels directly from those images. Doing this in a lab, he said, typically costs around €100 a sample. “Instead of paying that for every single sample, you can just use the image that you have in any case and try to predict the gene expression out of that.”

Right now, the team is focused pretty much exclusively on computational pathology of tissue sample images, primarily through hematoxylin and eosin (H&E) stains that reveal the structure and morphology of the tissue sample. These stains are also used by clinicians and labs for diagnosis. Cancer is by far the most common application of this kind of analysis.

Obstacles & opportunities

Of course, working with health data is tricky, even several years after the advent of Covid. “That’s an issue at the moment,” Ruusuvuori said when asked about access to clinical data. “We can’t really have the clinical samples from the clinics that are used for treating the patients, so at the moment what we are using is the public datasets because of the very strict regulations in Finland … which we are all the time trying to change.”

“LUMI, at the moment, [being] in Finland, it cannot be used for processing these routine clinical samples,” he added. “So that’s a major obstacle for us to achieve what we really want to achieve.”

Until those obstacles change, the team is using tens of thousands of public domain tissue sample images to train their model, which the team built from the ground up.

“We are pushing as hard as possible to be one of the first ones who will build the very large pre-trained models to understand histology,” Ruusuvuori said. “I think we have a good chance to really build a model that is more comprehensive than what has been available before.” He elaborated that when working with prostate cancer data with colleagues from Sweden – before they had access to LUMI – the model was able to perform cancer detection and grading at expert-level accuracy. “Now we can really try to scale it up with much, much more data using LUMI.”

On LUMI, the team is using the LUMI-G partition – the most powerful segment of the machine, comprising the vast bulk of its Linpack rating. The jobs run by ComPatAI each take between 50 and 100 of LUMI-G’s 2,560 nodes.

The LUMI supercomputer. Image courtesy of CSC.

What’s next

While ComPatAI’s team is a research group, they do have an eye toward commercialization. “Research can only take you so far,” Ruusuvuori said. “We really want to bring this technology to the point of benefit of the patient.”

The research team is currently applying for more funding and time on LUMI, and they expect to share preliminary results from their initial research on the new supercomputer (maybe) later this year – but Ruusuvuori said they are “hoping to continue this research for a long, long time.”

“We are not pathologists or medical doctors,” he added, “but we try to solve real-world problems and try to help pathologists and physicians cope with the flood of data that they get.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Watsonx Brings AI Visibility to Banking Systems

September 21, 2023

A new set of AI-based code conversion tools is available with IBM watsonx. Before introducing the new "watsonx," let's talk about the previous generation Watson, perhaps better known as "Jeopardy!-Watson." The origi Read more…

Researchers Advance Topological Superconductors for Quantum Computing

September 21, 2023

Quantum computers process information using quantum bits, or qubits, based on fragile, short-lived quantum mechanical states. To make qubits robust and tailor them for applications, researchers from the Department of Ene Read more…

Fortran: Still Compiling After All These Years

September 20, 2023

A recent article appearing in EDN (Electrical Design News) points out that on this day, September 20, 1954, the first Fortran program ran on a mainframe computer. Originally developed by IBM, Fortran (or FORmula TRANslat Read more…

Intel’s Gelsinger Lays Out Vision and Map at Innovation 2023 Conference

September 20, 2023

Intel’s sprawling, optimistic vision for the future was on full display yesterday in CEO Pat Gelsinger’s opening keynote at the Intel Innovation 2023 conference being held in San Jose. While technical details were sc Read more…

Intel Showcases “AI Everywhere” Strategy in MLPerf Inferencing v3.1

September 18, 2023

Intel used the latest MLPerf Inference (version 3.1) results as a platform to reinforce its developing “AI Everywhere” vision, which rests upon 4th gen Xeon CPUs and Gaudi2 (Habana) accelerators. Both fared well on t Read more…

AWS Solution Channel

Shutterstock 1679562793

How Maxar Builds Short Duration ‘Bursty’ HPC Workloads on AWS at Scale

Introduction

High performance computing (HPC) has been key to solving the most complex problems in every industry and has been steadily changing the way we work and live. Read more…

QCT Solution Channel

QCT and Intel Codeveloped QCT DevCloud Program to Jumpstart HPC and AI Development

Organizations and developers face a variety of issues in developing and testing HPC and AI applications. Challenges they face can range from simply having access to a wide variety of hardware, frameworks, and toolkits to time spent on installation, development, testing, and troubleshooting which can lead to increases in cost. Read more…

Survey: Majority of US Workers Are Already Using Generative AI Tools, But Company Policies Trail Behind

September 18, 2023

A new survey from the Conference Board indicates that More than half of US employees are already using generative AI tools, at least occasionally, to accomplish work-related tasks. Yet some three-quarters of companies st Read more…

Watsonx Brings AI Visibility to Banking Systems

September 21, 2023

A new set of AI-based code conversion tools is available with IBM watsonx. Before introducing the new "watsonx," let's talk about the previous generation Watson Read more…

Intel’s Gelsinger Lays Out Vision and Map at Innovation 2023 Conference

September 20, 2023

Intel’s sprawling, optimistic vision for the future was on full display yesterday in CEO Pat Gelsinger’s opening keynote at the Intel Innovation 2023 confer Read more…

Intel Showcases “AI Everywhere” Strategy in MLPerf Inferencing v3.1

September 18, 2023

Intel used the latest MLPerf Inference (version 3.1) results as a platform to reinforce its developing “AI Everywhere” vision, which rests upon 4th gen Xeon Read more…

China’s Quiet Journey into Exascale Computing

September 17, 2023

As reported in the South China Morning Post HPC pioneer Jack Dongarra mentioned the lack of benchmarks from recent HPC systems built by China. “It’s a we Read more…

Nvidia Releasing Open-Source Optimized Tensor RT-LLM Runtime with Commercial Foundational AI Models to Follow Later This Year

September 14, 2023

Nvidia's large-language models will become generally available later this year, the company confirmed. Organizations widely rely on Nvidia's graphics process Read more…

MLPerf Releases Latest Inference Results and New Storage Benchmark

September 13, 2023

MLCommons this week issued the results of its latest MLPerf Inference (v3.1) benchmark exercise. Nvidia was again the top performing accelerator, but Intel (Xeo Read more…

Need Some H100 GPUs? Nvidia is Listening

September 12, 2023

During a recent earnings call, Tesla CEO Elon Musk, the world's richest man, summed up the shortage of Nvidia enterprise GPUs in a few sentences.  "We're us Read more…

Intel Getting Squeezed and Benefiting from Nvidia GPU Shortages

September 10, 2023

The shortage of Nvidia's GPUs has customers searching for scrap heap to kickstart makeshift AI projects, and Intel is benefitting from it. Customers seeking qui Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

ISC 2023 Booth Videos

Cornelis Networks @ ISC23
Dell Technologies @ ISC23
Intel @ ISC23
Lenovo @ ISC23
Microsoft @ ISC23
ISC23 Playlist
  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire