Fujitsu Leverages Deep Learning in World’s Most Accurate Recognition of Complex Behaviors

January 13, 2021

TOKYO, Jan. 13, 2021 — Fujitsu Laboratories Ltd. has announced the development of a technology that utilizes deep learning to recognize the positions and connections of adjacent joints in complex movements or behavior in which multiple joints move in tandem. This makes it possible to achieve greater accuracy in recognizing, for instance, when a person performs a task like removing objects from a box. This technology successfully achieved the world’s highest accuracy against the world standard benchmark in the field of behavior recognition, with significant gains over the results achieved using conventional technologies, which don’t make use of information on neighboring joints.

Fig. 1 Outline of the newly developed technology compared with conventional technologies

By leveraging this technology to perform checks of manufacturing procedures or unsafe behavior in public spaces, Fujitsu aims to contribute to significant improvements in public safety and in the work place, helping to deliver on the promise of a safer and more secure society for all.

Fujitsu will present the details of this technology at the 25th International Conference on Pattern Recognition (ICPR 2020), which is being held online from January 10th, 2021 (Sunday) to January 15th, 2021 (Friday).

Background

In recent years, advances in AI technology have made it possible to recognize human behavior from video images using deep learning. This technology offers a variety of promising applications in a wide range of real-world scenarios, for example, in performing checks of manufacturing procedures in factories or detecting unsafe behavior in public spaces. In general, human behavior recognition utilizing AI relies on temporal changes in the position of each of the skeletal joints, including in the hands, elbows, and shoulders, as identifying features, which are then linked to simple movement patterns such as standing or sitting.
With time series behavior-recognition technology developed by Fujitsu Labs, Fujitsu has successfully realized highly-accurate image recognition using a deep learning model that can operate with high-accuracy even for complex behaviors in which multiple joints change in conjunction with each other, such as removing objects from a box during unpacking.

About the Newly Developed Technology

Complex movements like unpacking involve hand, elbow, and shoulder joints moving in tandem with the arm bending and stretching. Fujitsu has developed a new AI model for a graph convolutional neural networks that performs convolution operation of the graph structure by adopting a graph consisting of edges connecting adjacent joints based on the structure of the human body with the joint position as a node (Vertex). By training this model in advance using the time series data of joints, the connection strength (Weight) with neighboring joints can be optimized, and effective connection relationships for behavior recognition can be acquired. With conventional technologies, it was necessary to accurately grasp the individual characteristics of each joint. With an AI model that has already been trained, the combined features of the adjacent joints that are linked can be extracted, making it possible to achieve highly-accurate recognition for complex movements.

This technology was evaluated against the world standard benchmark in the field of behavior recognition using skeleton data, and in the case of simple behaviors such as standing and sitting in the open data set, the accuracy rate was maintained at the same level as that of conventional technology that does not use information on neighboring joints. In the case of complex behaviors like a person unpacking a box or throwing an object, however, the accuracy rate improved greatly, to achieve an overall improvement of more than 7% over the conventional alternative to reach the world’s highest recognition accuracy.

Future Plans

By adding the newly developed AI model for recognizing complex behaviors obtained with this technology to the 100 basic behavior already accommodated by Fujitsu’s behavioral analysis technology “Actlyzer,”, it will become possible rapidly deploy new, highly-accurate recognition models. Fujitsu ultimately aims to leverage this new capability to roll out the system in fiscal year 2021, and contribute to the resolution of real-world issues to deliver a safer and more secure society.

  1. World’s highest accuracy: As of January 13th, 2021. In the Kinetics-Skeleton category.
  2. World standard benchmark: Kinetics-Skeleton dataset benchmarks.
  3. graph convolutional neural networks: Deep neural network for convolutional operation on graph structure.
  4. Same level as that of conventional technology. Using the Kinetics-Skeleton dataset released by Chinese University of Hong Kong, an evaluation was made with the technology released by the same university in 2018. The correct answer rate is the rate at which the predicted result matches the correct answer.
  5. Behavioral analysis technology “Actlyzer”. Deep learning technology that can recognize a variety of subtle and complex human movements without relying on large amounts of training data. (Press Release: 2019/11/25)

About Fujitsu

Fujitsu is a leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 130,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE:6702) reported consolidated revenues of 3.9 trillion yen (US$35 billion) for the fiscal year ended March 31, 2020. For more information, please see www.fujitsu.com.

About Fujitsu Laboratories

Founded in 1968 as a wholly owned subsidiary of Fujitsu Limited, Fujitsu Laboratories Ltd. is one of the premier research centers in the world. With a global network of laboratories in Japan, China, the United States and Europe, the organization conducts a wide range of basic and applied research in the areas of Next-generation Services, Computer Servers, Networks, Electronic Devices and Advanced Materials. For more information, please see: http://www.fujitsu.com/jp/group/labs/en/.


Source: Fujitsu Laboratories Ltd. 

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

IBM’s Prototype Low-Power 7nm AI Chip Offers ‘Precision Scaling’

February 23, 2021

IBM has released details of a prototype AI chip geared toward low-precision training and inference across different AI model types while retaining model quality within AI applications. In a paper delivered during this Read more…

By George Leopold

Dompé Announces Exscalate4CoV’s Successor in the HPC Fight Against Pandemics

February 23, 2021

More than a year ago, the Italian-based Exscalate4CoV consortium stormed onto the scene to fight COVID-19 through drug discovery, powered by supercomputers and databases from dozens of partners across seven European coun Read more…

By Oliver Peckham

IBM Continues Mainstreaming Power Systems and Integrating Red Hat in Pivot to Cloud

February 23, 2021

As IBM continues its massive pivot to the cloud, its Power-microprocessor-based products are being mainstreamed and realigned with the corporate-wide strategy. HPC, while not out, is being de-emphasized and traditional e Read more…

By John Russell

Supercomputer Research May Have Solved a Planetary Mystery

February 19, 2021

For decades, astronomers have struggled to explain why planets with intermediate masses – such as Uranus and Neptune – overwhelmingly outnumber planets of other sizes. Now, using the power of supercomputing, research Read more…

By Oliver Peckham

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

By Tiffany Trader

AWS Solution Channel

FLSmidth Drives Sustainable Productivity while Reducing Time and Costs Using HPC on AWS

FLSmidth is a global leader with nearly 140 years’ experience in the cement industry.  Since their founder in 1882 discovered the technology behind the horizontal cement kiln, innovation has been at the core of FLSmidth’s culture.  Read more…

Fugaku-Trained AI Model to Monitor Tsunamis

February 18, 2021

Last year, Riken launched Fugaku, the world’s fastest supercomputer, a year ahead of schedule. The system launched early in order to combat a disaster threatening Japan: COVID-19. Now, with the pandemic appearing to wa Read more…

By Oliver Peckham

IBM Continues Mainstreaming Power Systems and Integrating Red Hat in Pivot to Cloud

February 23, 2021

As IBM continues its massive pivot to the cloud, its Power-microprocessor-based products are being mainstreamed and realigned with the corporate-wide strategy. Read more…

By John Russell

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

By Tiffany Trader

ENIAC at 75: Celebrating the World’s First Supercomputer

February 15, 2021

With little fanfare, today’s computer revolution was arguably born and announced through a small, innocuous, two-column story at the bottom of the front page of The New York Times on Feb. 15, 1946. In that story and others, the previously classified project, ENIAC... Read more…

By Todd R. Weiss

Microsoft, HPE Bringing AI, Edge, Cloud to Earth Orbit in Preparation for Mars Missions

February 12, 2021

The International Space Station will soon get a delivery of powerful AI, edge and cloud computing tools from HPE and Microsoft Azure to expand technology experi Read more…

By Todd R. Weiss

DiRAC, AMD Team for ‘COSMA 8’ Cosmological Supercomputer

February 11, 2021

Despite its relatively vague name, DiRAC – which stands for “Distributed Research utilizing Advanced Computing” – serves predominantly specialized research communities, with emphases on fields like cosmology and nuclear physics. Now, in partnership with AMD, one of DiRAC’s... Read more…

By Oliver Peckham

Air Force Launches Cray Weather Forecasting Supercomputer in Partnership with HPE, ORNL

February 10, 2021

The U.S. Department of Energy's Oak Ridge National Laboratory (ORNL) is now home to one of the first HPE Cray EX supercomputing deployments, which ORNL's Nation Read more…

By Tiffany Trader

How Lenovo Upgraded the DreamWorks Datacenter During a Pandemic

February 10, 2021

DreamWorks Animation has produced some of the most popular animated movies of the last 25 years, from Shrek and Madagascar to Kung Fu Panda and How to Train Your Dragon. As an early mover in 3D animation and one of the first challengers to Pixar, DreamWorks requires powerful hardware... Read more…

By Oliver Peckham

SYCL 2020 Launches with New Name, New Features, and High Ambition

February 9, 2021

The Khronos Group today formally launched SYCL 2020, the parallel programming framework based on IS0 standard C++ that has been gaining traction in HPC and will Read more…

By John Russell

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

By John Russell

Esperanto Unveils ML Chip with Nearly 1,100 RISC-V Cores

December 8, 2020

At the RISC-V Summit today, Art Swift, CEO of Esperanto Technologies, announced a new, RISC-V based chip aimed at machine learning and containing nearly 1,100 low-power cores based on the open-source RISC-V architecture. Esperanto Technologies, headquartered in... Read more…

By Oliver Peckham

Azure Scaled to Record 86,400 Cores for Molecular Dynamics

November 20, 2020

A new record for HPC scaling on the public cloud has been achieved on Microsoft Azure. Led by Dr. Jer-Ming Chia, the cloud provider partnered with the Beckman I Read more…

By Oliver Peckham

NICS Unleashes ‘Kraken’ Supercomputer

April 4, 2008

A Cray XT4 supercomputer, dubbed Kraken, is scheduled to come online in mid-summer at the National Institute for Computational Sciences (NICS). The soon-to-be petascale system, and the resulting NICS organization, are the result of an NSF Track II award of $65 million to the University of Tennessee and its partners to provide next-generation supercomputing for the nation's science community. Read more…

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

By Tracey Bryant

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

Top500: Fugaku Keeps Crown, Nvidia’s Selene Climbs to #5

November 16, 2020

With the publication of the 56th Top500 list today from SC20's virtual proceedings, Japan's Fugaku supercomputer – now fully deployed – notches another win, Read more…

By Tiffany Trader

Texas A&M Announces Flagship ‘Grace’ Supercomputer

November 9, 2020

Texas A&M University has announced its next flagship system: Grace. The new supercomputer, named for legendary programming pioneer Grace Hopper, is replacing the Ada system (itself named for mathematician Ada Lovelace) as the primary workhorse for Texas A&M’s High Performance Research Computing (HPRC). Read more…

By Oliver Peckham

Leading Solution Providers

Contributors

Gordon Bell Special Prize Goes to Massive SARS-CoV-2 Simulations

November 19, 2020

2020 has proven a harrowing year – but it has produced remarkable heroes. To that end, this year, the Association for Computing Machinery (ACM) introduced the Read more…

By Oliver Peckham

At Oak Ridge, ‘End of Life’ Sometimes Isn’t

October 31, 2020

Sometimes, the old dog actually does go live on a farm. HPC systems are often cursed with short lifespans, as they are continually supplanted by the latest and Read more…

By Oliver Peckham

Intel Xe-HP GPU Deployed for Aurora Exascale Development

November 17, 2020

At SC20, Intel announced that it is making its Xe-HP high performance discrete GPUs available to early access developers. Notably, the new chips have been deplo Read more…

By Tiffany Trader

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

By Oliver Peckham

Intel Teases Ice Lake-SP, Shows Competitive Benchmarking

November 17, 2020

At SC20 this week, Intel teased its forthcoming third-generation Xeon "Ice Lake-SP" server processor, claiming competitive benchmarking results against AMD's second-generation Epyc "Rome" processor. Ice Lake-SP, Intel's first server processor with 10nm technology... Read more…

By Tiffany Trader

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

By John Russell

It’s Fugaku vs. COVID-19: How the World’s Top Supercomputer Is Shaping Our New Normal

November 9, 2020

Fugaku is currently the most powerful publicly ranked supercomputer in the world – but we weren’t supposed to have it yet. The supercomputer, situated at Japan’s Riken scientific research institute, was scheduled to come online in 2021. When the pandemic struck... Read more…

By Oliver Peckham

Nvidia-Arm Deal a Boon for RISC-V?

October 26, 2020

The $40 billion blockbuster acquisition deal that will bring chipmaker Arm into the Nvidia corporate family could provide a boost for the competing RISC-V architecture. As regulators in the U.S., China and the European Union begin scrutinizing the impact of the blockbuster deal on semiconductor industry competition and innovation, the deal has at the very least... Read more…

By George Leopold

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire