Using Neural Networks to Read Minds

December 16, 2019

Researchers from McGill University and the University of Montreal are decoding the brain using neural networks

In the development of artificial intelligence applications, the holy grail is the creation of an artificial neural network that functions like the human brain. This is an elusive goal, because the human brain is an extremely complex organ that functions in flexible and fluid ways that can be difficult to replicate in the world of AI.

Today, a team of researchers from McGill University and the University of Montreal are making breakthroughs with functional magnetic resonance imaging (fMRI) of people’s brains while carrying out various cognitive tasks. The goal is to develop better understand and create computational models of how the brain works, and then use those models to train artificial neural networks to map the images to actions quickly and accurately. Yes, we’re talking about mind reading.

This would be a big leap forward for the AI world, according to one of the lead researchers on the project, Dr. Pierre Bellec, an associate professor at the University of Montreal. Dr. Bellec is the scientific director of the Courtois Project on Neuronal Modelling (NeuroMod), which is spearheading the collaborative research effort.

“Something the brain does really well is to switch from one context to another,” Dr. Bellec explains. “It has very elaborate organization, and specialized networks and subnetworks, and those networks and subnetworks are able to reconfigure dynamically. By contrast, current architectures used by AI researchers are extremely specialized for certain types of tasks, and have a hard time generalizing over different contexts.”

The researchers hope that by mimicking the architecture of the human brain, they can develop a more versatile AI model that can generalize over different tasks, much the way the human brain does.

“AI has been an inspiration forever, but here we are not just drawing general principles, we are doing extensive imaging to map out the full activities of the brain in an unprecedented level of detail,” Dr. Bellec explains. “We’re hoping to be able to draw directly from rich data to gain insight on how the brain works, rather than drawing from general, vague principles.”

To collect the datasets for this ambitious effort, the research team has recruited a small group of volunteers — a half dozen subjects — to watch videos, look at images and play video games while they are in an MRI machine. The research team had to build a new game controller without any metal, printed in 3D plastic with a fiber optic cable connection! The machine allows the researchers to track and record the activity in the brains of the subjects as they carry out their tasks. The research team expects to gather many terabytes of data over the course of the five-year study, during which time each subject will spend around 500 hours in an MRI machine.

“Essentially, we are trying to find a new way to integrate activity from human neural networks to help train artificial networks,” Dr. Bellec says. “The hope is that if we manage to do that, we can create computational models of how the brain works. And potentially we can train new artificial neural networks that may perform better in some settings than what we have now.”

The computing infrastructure and initial benchmarks

To move this project forward, researchers from the University of Montreal teamed up with researchers from McGill University who have extensive experience in high performance computing and work with MRI images that require large memory capacities.

They also sought the help of Dell EMC and Intel, along with the supercomputing resources of the Dell EMC HPC and AI Innovation Lab in Austin, Texas. The team is using the lab’s Intel-based Zenith cluster, which includes hundreds of Dell EMC PowerEdge servers with Intel Xeon® Scalable Processors and the Intel® Omni‑Path Architecture.

“People have done a lot of training on GPUs,” Dr. Bellec says. “We wanted to use CPUs for this project, thinking a CPU architecture with a large memory capacity would be better for larger files. We thought this type of hardware would be a perfect fit for our use case, so we decided to run some benchmarks.”

After testing on a GPU architecture, the team found that a CPU-based model can maintain similar performance – with validation accuracy reaching 99% after 10 epochs for motor task, and 91% after 20 epochs for working-memory task – as the GPU based models, but requires much less training time – 20 minutes vs 3 hours per epoch using 10 CPUs and two GPUs, respectively. Considering that, in the real world, the CPU resources are more easily accessed and cost less, the project provides a more feasible solution for the application of deep neural networks on large-scale neuroimaging data by training the model directly on CPU hubs instead of waiting for the GPU resources.

For those initial benchmarks, which kicked off the NeuroMod project, the research team used publicly available datasets from the Human Connectome Project, according to team member Dr. Yu Zhang, a computational neuroscientist affiliated with the University of Montreal. The Connectome Project, which is mapping the neural connections in the brain, offers researchers access to fMRI scans from 1,200 subjects.

“Currently, we’re using that project data and trying to do the de-coding.” Dr. Yu Zhang says. “The neural networks take a short series of this fMRI data and try to predict the specific task the subject was performing during the scanning.”

In the benchmarks on the public dataset, the team is evaluating the performance of two different architectures — a traditional convolutional neural networks and a more complex one, called ResNet, that has been used a lot in image processing.

“The benchmarks we are doing are what we call brain decoding, or in layman’s terms, mind reading,” Dr. Bellec adds. “You look at brain images and try to guess what people were doing. In the next stage, we will have our own data, in which we play video games. The idea is to try to train an artificial neural network to play the video game in the style of the particular player.”

Big data and big memory

By its nature, NeuroMod is a project that needs an HPC system with a large memory capacity to handle terabytes of data. In the initial benchmarks on the public dataset from the Human Connectome Project, the research team was dealing with 9 terabytes of compressed data, or 20 terabytes in an uncompressed form.

“And that’s only for the brain images,” Dr. Bellec says. “We are also collecting data from all the videos, and we are collecting a lot of physical data on the subjects, including heartbeat, respiration and the small motion of their eyes in very high resolution. All those auxiliary data, which we will eventually use in the model, can add a tens of terabytes of data.”

This deluge of data makes it all the more important to have ready access to an HPC cluster with big memory, which is what the team is getting through the Dell EMC HPC and AI Innovation Lab.

“We got access to the cluster in June, and it’s been very productive for us,” Dr. Bellec says. “We have been able to run a number of benchmarks that we had not been able to run prior to that time. And this is just the beginning, or so we hope. We’re getting familiar with the computing hardware architecture for deep learning, which we plan to use for years to come.”

This is just part of the process when a research team is breaking new ground. Oftentimes, organizations need new HPC architectures that are built for the challenges of huge datasets and unique workloads.

“Many people are excited about being able to evolve neural networks in ways that are inspired by biology, and it’s increasingly clear that we need a different type of hardware to do that,” Dr. Bellec says. “And that’s what we have with the Zenith cluster in the Dell EMC HPC and AI Innovation Lab.”

To learn  more

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

HPC Career Notes: June 2020 Edition

June 1, 2020

In this monthly feature, we'll keep you up-to-date on the latest career developments for individuals in the high-performance computing community. Whether it's a promotion, new company hire, or even an accolade, we've got Read more…

By Mariana Iriarte

Supercomputer Modeling Shows How COVID-19 Spreads Through Populations

May 30, 2020

As many states begin to loosen the lockdowns and stay-at-home orders that have forced most Americans inside for the past two months, researchers are poring over the data, looking for signs of the dreaded second peak of t Read more…

By Oliver Peckham

SODALITE: Towards Automated Optimization of HPC Application Deployment

May 29, 2020

Developing and deploying applications across heterogeneous infrastructures like HPC or Cloud with diverse hardware is a complex problem. Enabling developers to describe the application deployment and optimising runtime p Read more…

By the SODALITE Team

What’s New in HPC Research: Astronomy, Weather, Security & More

May 29, 2020

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

DARPA Looks to Automate Secure Silicon Designs

May 28, 2020

The U.S. military is ramping up efforts to secure semiconductors and its electronics supply chain by embedding defenses during the chip design phase. The automation effort also addresses the high cost and complexity of s Read more…

By George Leopold

AWS Solution Channel

Computational Fluid Dynamics on AWS

Over the past 30 years Computational Fluid Dynamics (CFD) has grown to become a key part of many engineering design processes. From aircraft design to modelling the blood flow in our bodies, the ability to understand the behaviour of fluids has enabled countless innovations and improved the time to market for many products. Read more…

COVID-19 HPC Consortium Expands to Europe, Reports on Research Projects

May 28, 2020

The COVID-19 HPC Consortium, a public-private effort delivering free access to HPC processing for scientists pursuing coronavirus research – some utilizing AI-based techniques – has expanded to more than 56 research Read more…

By Doug Black

COVID-19 HPC Consortium Expands to Europe, Reports on Research Projects

May 28, 2020

The COVID-19 HPC Consortium, a public-private effort delivering free access to HPC processing for scientists pursuing coronavirus research – some utilizing AI Read more…

By Doug Black

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

IBM Boosts Deep Learning Accuracy on Memristive Chips

May 27, 2020

IBM researchers have taken another step towards making in-memory computing based on phase change (PCM) memory devices a reality. Papers in Nature and Frontiers Read more…

By John Russell

Hats Over Hearts: Remembering Rich Brueckner

May 26, 2020

HPCwire and all of the Tabor Communications family are saddened by last week’s passing of Rich Brueckner. He was the ever-optimistic man in the Red Hat presiding over the InsideHPC media portfolio for the past decade and a constant presence at HPC’s most important events. Read more…

Nvidia Q1 Earnings Top Expectations, Datacenter Revenue Breaks $1B

May 22, 2020

Nvidia’s seemingly endless roll continued in the first quarter with the company announcing blockbuster earnings that exceeded Wall Street expectations. Nvidia Read more…

By Doug Black

Microsoft’s Massive AI Supercomputer on Azure: 285k CPU Cores, 10k GPUs

May 20, 2020

Microsoft has unveiled a supercomputing monster – among the world’s five most powerful, according to the company – aimed at what is known in scientific an Read more…

By Doug Black

HPC in Life Sciences 2020 Part 1: Rise of AMD, Data Management’s Wild West, More 

May 20, 2020

Given the disruption caused by the COVID-19 pandemic and the massive enlistment of major HPC resources to fight the pandemic, it is especially appropriate to re Read more…

By John Russell

AMD Epyc Rome Picked for New Nvidia DGX, but HGX Preserves Intel Option

May 19, 2020

AMD continues to make inroads into the datacenter with its second-generation Epyc "Rome" processor, which last week scored a win with Nvidia's announcement that Read more…

By Tiffany Trader

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers

SC 2019 Virtual Booth Video Tour

AMD
AMD
ASROCK RACK
ASROCK RACK
AWS
AWS
CEJN
CJEN
CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
IBM
IBM
MELLANOX
MELLANOX
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
SIX NINES IT
SIX NINES IT
VERNE GLOBAL
VERNE GLOBAL
WEKAIO
WEKAIO

Contributors

Fujitsu A64FX Supercomputer to Be Deployed at Nagoya University This Summer

February 3, 2020

Japanese tech giant Fujitsu announced today that it will supply Nagoya University Information Technology Center with the first commercial supercomputer powered Read more…

By Tiffany Trader

Tech Conferences Are Being Canceled Due to Coronavirus

March 3, 2020

Several conferences scheduled to take place in the coming weeks, including Nvidia’s GPU Technology Conference (GTC) and the Strata Data + AI conference, have Read more…

By Alex Woodie

Exascale Watch: El Capitan Will Use AMD CPUs & GPUs to Reach 2 Exaflops

March 4, 2020

HPE and its collaborators reported today that El Capitan, the forthcoming exascale supercomputer to be sited at Lawrence Livermore National Laboratory and serve Read more…

By John Russell

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Cray to Provide NOAA with Two AMD-Powered Supercomputers

February 24, 2020

The United States’ National Oceanic and Atmospheric Administration (NOAA) last week announced plans for a major refresh of its operational weather forecasting supercomputers, part of a 10-year, $505.2 million program, which will secure two HPE-Cray systems for NOAA’s National Weather Service to be fielded later this year and put into production in early 2022. Read more…

By Tiffany Trader

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This