LANL Researchers Design New Artificial Synapses for Neuromorphic Computing

June 2, 2023

June 2, 2023 — The human brain has been called the most complicated object in the universe. Trying to replicate that still-unmatched capability for computing, scientists at Los Alamos National Laboratory have made a new interface-type memristive device, which their results suggest can be used to build artificial synapses for next-generation neuromorphic computing. Memristive devices, or memristors, represent long-sought circuit technology that, unlike current resistor technology, has both programming and memory capabilities — memristors could remember which electrical state they were in when powered off, a human brain-like ability that opens up new possibilities for computing and devices.

Tested against a dataset of handwritten images from the Modified National Standards and Technology database, the interface-type memristors realized a high image recognition accuracy of 94.72%. Image: LANL.

“Data processing is an essential part of today’s science, with machine learning, artificial intelligence and artificial neural networks used to address pressing questions in everything from climate science to national security applications,” said Aiping Chen, Laboratory scientist with the Center for Integrated Nanotechnologies. “But conventional computing architecture demands a great deal of energy and is increasingly less able to scale up to meet bigger and bigger data challenges. Neuromorphic computing, which mimics the unmatched data storage and processing architecture and capabilities of the human brain, offers a path to continue to extend computing performance.”

Conventional computing is constrained by the so-called von Neumann bottleneck, in which computing and memory are separate. Processing advanced tasks like machine learning and image recognition on digital computers consume a significant amount of energy and time due to transferring the data back and forth between a central processing unit and memory. Data center energy consumption has increased rapidly in the past few years, with projections that approximately 8% of the world’s electricity will be used by data centers by 2030.

Additionally, in conventional computer architecture, billions of transistors on silicon-based microchips serve as switches for a computer’s binary code. Physical limits to the miniaturization of those transistors have helped spell the end of Moore’s Law, a maxim that foretold the doubling of processing power roughly every two years.

In-Memory Computing: Just Like a Brain

Co-locating information storage and processing at synapses, which connect the 100 billion neurons sending and receiving chemical information, the human brain’s “in-memory processing” saves time and energy. Neuromorphic computing relies on emergent devices such as memristors, switches between two terminals that control and remember the charge flowing through, to replicate the structure and function of synapses.

In the fast-evolving field of neuromorphic computing, memristor designs have included filament systems, in which a charge is delivered through the devices. But, prone to overheating, filament systems lack stability and reliability.

Chen and his colleagues are working on a different approach called an interface-type memristor, and have produced a reliable, high-performing device with a simple structure based on an Au/Nb-doped SrTiO3 interface — essentially gold and other semiconducting materials. The interface-type memristors can, in principle, be scaled down to nanometer size that even filament-based memristor technology cannot achieve. (By contrast, a human hair is approximately 100,000 nanometers thick.) And especially in contrast to transistor-based neuromorphic chips, the interface-type memristive device needs significantly less power to fuel its processing.

“Different from digital computing with a von Neumann architecture, neuromorphic computing, inspired by biological systems, works just like a brain,” said Chen. “The advantages of that structure include low-energy consumption, high parallelism and excellent error tolerance. The human brain runs at only 20 watts, after all, but learns extremely effectively. These advantages make it very good for advanced computing tasks like learning, recognition and decision-making.”

Excelling at Advanced Computing Tasks

The team used artificial neural-network simulation to study the computing performance of the interface-type memristor, testing it against a dataset of handwritten images from the Modified National Standards and Technology database maintained by the National Institute of Standards and Technology. Demonstrating excellent uniformity, programmability and reliability, the device realized a recognition accuracy of 94.72%.

That performance makes the team believe these new interface-type memristive devices can be a fundamental hardware piece for next-generation neuromorphic computing.

“The capabilities we’re seeing suggest that neuromorphic chips, like human brains, will be good at advanced tasks that include learning and real-time decision-making,” said Chen. “We could see neuromorphic computing enable a lot of applications that require intelligence, from self-driving cars, to drones, to security cameras. Basically, many things that people are capable of doing, these types of devices will be able to do.”

The team plans to continue to develop the technology with an emphasis on the need for co-design — hardware design informed by algorithmic approaches offered by computer scientists.

Paper: “An Interface-Type Memristive Device for Artificial Synapse and Neuromorphic Computing,” Advanced Intelligent Systems. DOI: 10.1002/aisy.202300035

Funding: The work was supported by the Laboratory Directed Research and Development program at Los Alamos National Laboratory, the NNSA and the U.S. Department of Energy Office of Science’s funding of the Center for Integrated Nanotechnologies.


Source: LANL

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Watsonx Brings AI Visibility to Banking Systems

September 21, 2023

A new set of AI-based code conversion tools is available with IBM watsonx. Before introducing the new "watsonx," let's talk about the previous generation Watson, perhaps better known as "Jeopardy!-Watson." The origi Read more…

Researchers Advance Topological Superconductors for Quantum Computing

September 21, 2023

Quantum computers process information using quantum bits, or qubits, based on fragile, short-lived quantum mechanical states. To make qubits robust and tailor them for applications, researchers from the Department of Ene Read more…

Fortran: Still Compiling After All These Years

September 20, 2023

A recent article appearing in EDN (Electrical Design News) points out that on this day, September 20, 1954, the first Fortran program ran on a mainframe computer. Originally developed by IBM, Fortran (or FORmula TRANslat Read more…

Intel’s Gelsinger Lays Out Vision and Map at Innovation 2023 Conference

September 20, 2023

Intel’s sprawling, optimistic vision for the future was on full display yesterday in CEO Pat Gelsinger’s opening keynote at the Intel Innovation 2023 conference being held in San Jose. While technical details were sc Read more…

Intel Showcases “AI Everywhere” Strategy in MLPerf Inferencing v3.1

September 18, 2023

Intel used the latest MLPerf Inference (version 3.1) results as a platform to reinforce its developing “AI Everywhere” vision, which rests upon 4th gen Xeon CPUs and Gaudi2 (Habana) accelerators. Both fared well on t Read more…

AWS Solution Channel

Shutterstock 1679562793

How Maxar Builds Short Duration ‘Bursty’ HPC Workloads on AWS at Scale

Introduction

High performance computing (HPC) has been key to solving the most complex problems in every industry and has been steadily changing the way we work and live. Read more…

QCT Solution Channel

QCT and Intel Codeveloped QCT DevCloud Program to Jumpstart HPC and AI Development

Organizations and developers face a variety of issues in developing and testing HPC and AI applications. Challenges they face can range from simply having access to a wide variety of hardware, frameworks, and toolkits to time spent on installation, development, testing, and troubleshooting which can lead to increases in cost. Read more…

Survey: Majority of US Workers Are Already Using Generative AI Tools, But Company Policies Trail Behind

September 18, 2023

A new survey from the Conference Board indicates that More than half of US employees are already using generative AI tools, at least occasionally, to accomplish work-related tasks. Yet some three-quarters of companies st Read more…

Watsonx Brings AI Visibility to Banking Systems

September 21, 2023

A new set of AI-based code conversion tools is available with IBM watsonx. Before introducing the new "watsonx," let's talk about the previous generation Watson Read more…

Intel’s Gelsinger Lays Out Vision and Map at Innovation 2023 Conference

September 20, 2023

Intel’s sprawling, optimistic vision for the future was on full display yesterday in CEO Pat Gelsinger’s opening keynote at the Intel Innovation 2023 confer Read more…

Intel Showcases “AI Everywhere” Strategy in MLPerf Inferencing v3.1

September 18, 2023

Intel used the latest MLPerf Inference (version 3.1) results as a platform to reinforce its developing “AI Everywhere” vision, which rests upon 4th gen Xeon Read more…

China’s Quiet Journey into Exascale Computing

September 17, 2023

As reported in the South China Morning Post HPC pioneer Jack Dongarra mentioned the lack of benchmarks from recent HPC systems built by China. “It’s a we Read more…

Nvidia Releasing Open-Source Optimized Tensor RT-LLM Runtime with Commercial Foundational AI Models to Follow Later This Year

September 14, 2023

Nvidia's large-language models will become generally available later this year, the company confirmed. Organizations widely rely on Nvidia's graphics process Read more…

MLPerf Releases Latest Inference Results and New Storage Benchmark

September 13, 2023

MLCommons this week issued the results of its latest MLPerf Inference (v3.1) benchmark exercise. Nvidia was again the top performing accelerator, but Intel (Xeo Read more…

Need Some H100 GPUs? Nvidia is Listening

September 12, 2023

During a recent earnings call, Tesla CEO Elon Musk, the world's richest man, summed up the shortage of Nvidia enterprise GPUs in a few sentences.  "We're us Read more…

Intel Getting Squeezed and Benefiting from Nvidia GPU Shortages

September 10, 2023

The shortage of Nvidia's GPUs has customers searching for scrap heap to kickstart makeshift AI projects, and Intel is benefitting from it. Customers seeking qui Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

ISC 2023 Booth Videos

Cornelis Networks @ ISC23
Dell Technologies @ ISC23
Intel @ ISC23
Lenovo @ ISC23
Microsoft @ ISC23
ISC23 Playlist
  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire