ISC21 Keynote: HPC-Powered Radar Tomography for Sustainable, Equitable Cities

By Oliver Peckham

June 29, 2021

ISC High Performance 2021 kicked off yesterday with a keynote from Dr. Xiaoxiang Zhu, a professor of data science and Earth observation at the Technical University of Munich. The conference, held virtually for the second time due to the ongoing coronavirus pandemic, featured a surprisingly COVID-light agenda, seeming to focus instead on building a better new normal than the status quo that the world left behind in 2020. To that end, Zhu’s keynote spotlighted how HPC-powered Earth observation data processing, carefully applied, has an incredible amount of transformative power.

Dr. Xiaoxiang Zhu

Zhu’s presentation kicked off with a graphic of a slowly spinning Earth with a lone satellite in polar orbit around it. As the Earth rotated, that polar orbit slowly gave the satellite coverage over the planet.

“We are living in a golden age of Earth observation,” Zhu said. The game-changer, she explained, was the European Space Agency’s Copernicus program and its Sentinel satellite fleet – an “evolutionary change” in Earth observation that occurred around 2014 to 2015, resulting in an explosion in satellite data. “The data we have so far [is] around 40 petabytes, and in 2030, it will become 140 petabytes,” Zhu said. “And what is more important is that most of the data is provided by the Sentinel satellite fleet, [which is] following the so-called ‘free and open policy.’ This means these petabytes of data are accessible to everybody – and also, you, who are in the audience.”

“Without any doubt,” she stated, “Earth observation is now a big data problem.”


“Without any doubt, Earth observation is now a big data problem.”


This big data problem has big implications for a wide range of fields, from meteorology (“the classic field where we are providing information”) to “very practical things related to safety, security, mobility, resource management and … city planning.”

“In my lab,” Zhu continued, “our vision is that we want to develop innovative AI and data science solutions in Earth observation for tackling societal grand challenges – for example, urbanization, climate change, or the UN’s SDGs [Sustainable Development Goals].”

Leveraging the petabytes of Earth observation data in service of these goals means enlisting “a wide range of expertise”: exploratory signal processing techniques, data fusion strategies and much more. And, of course: “If we talk about global applications then very easily we’re ending up with petabytes of geodata, satellite, social media data. Therefore, big data analytics and high-performance computing are very crucial components for the whole harvesting process.”

One of the most impressive efforts at Zhu’s lab is a deceptively simple pitch: global urban mapping.

A disparity in geoinformation

“We are now living on an urban planet,” Zhu said. “If you look at the urban population and the rural population – the evolution over time – you will figure out in 2008, there is a secret change [in] history: there are more people living in urban areas than rural areas. And this trend is going to increase in the future.”

As an isolated datapoint, this might not seem troubling. But the geospatial distribution of that accelerating urbanization, Zhu explained, was unequal: it was mostly occurring in developing areas that lacked sufficient urban planning to ensure that the urbanized areas were also safely habitable. By way of example: “In the last decade, nearly 50,000 fires happened in Mumbai,” Zhu said. “What was really shocking is [that] nearly 70 percent were simply caused by faulty wiring.”


“We are now living on an urban planet.”


In order to address those kinds of problems through improved urban planning, though, you need to know some basic geoinformation about the region. Where are the slums? Where are people living? How tall are the buildings? What functions do the buildings serve?

“We don’t have global information in fine detail available,” Zhu said. She pointed to OpenStreetMap, which she said many Europeans might view as a substantial source of such information. But while that might work for much of Europe, Zhu explained how small OpenStreetMap’s scope was in the scheme of the world. There are roughly three billion buildings in the world. 457 million of them – just 16 percent – are in OpenStreetMap. Of those, only three percent have height information – just half of one percent of the world’s buildings overall.

“And we,” Zhu said, “are using AI and data science to close this gap.”

Closing the building footprint gap

First, the team set out to collect building footprints. They used satellite data from Planet, a new aerospace company that provided data from around 140 very small satellites that Zhu said were able to provide data with an accuracy of four to five meters on a daily basis. Using training data from 74 cities, the team taught a graph convolutional neural network to understand the relationship between the satellite data and GIS-derived building footprints.

“All together, we processed more than 200,000 planet satellite images,” Zhu said. They were able to derive global building footprints from their model, allowing them to close the 84 percent gap of buildings that did not have footprints in OpenStreetMap.

In yellow, the building footprint data that was previously available in Marrakesh. In purple, the new building footprint information from Zhu’s team. Image courtesy of Xiaoxiang Zhu.

Then came the hard part: transforming 2D satellite data into 3D data that could be used to derive building heights, as well.

Radar tomography

For that, Zhu and her team turned to data from TerraSAR-X, a German radar satellite. Here, they used a technique called “radar tomography,” which is akin to the computed tomography (CT) scans that use rotating blasts of x-rays to generate 3D images out of a stack of 2D images taken from different angles.

“Similar to CT, you are doing a scan of the patient, and each of these satellite images could be considered a tomographic slide,” Zhu said. “And every 11 days the satellite will fly over the same area, taking the image from slightly different positions. After we build up enough … images, we’re able to basically do the reconstruction with tomographic methods.”

A simplified representation of the radio tomography process (with a CT machine in the corner). Image courtesy of Xiaoxiang Zhu.

“Similar to CT, you are doing a scan of the patient[.]”


This radar tomography work is extraordinarily compute-intensive, and it is, accordingly, powered by the HPC resources from the Leibniz Supercomputing Centre (LRZ). Zhu is a self-described “power user of SuperMUC[-NG],” the center’s largest supercomputer. SuperMUC-NG, which launched in 2018, consists of 6,336 Intel Xeon Skylake-powered “thin” compute nodes (each with 96 GB of memory) and 144 Skylake-powered “fat” compute nodes (each with 768 GB of memory). All told, SuperMUC-NG delivers 19.5 Linpack petaflops, placing it 17th on the most recent Top500 list (which launched the same day as the keynote).

“We are … using a lot of computing resources from the Leibniz Supercomputing Center, because eventually if we boil everything down to formulas we are solving for each of … approximately ten thousand times five thousand pixels,” Zhu said. “For each of those pixels, we are solving a long convex optimization problem with a matrix dimension of 100 times one million, and here we get a lot of support from Leibniz Supercomputing Center and have been granted … 46 million CPU hours for our social good project.”

And now, Zhu said, “I’m happy to show you around Berlin!”

A pointillist metropolis — and eventually, a world

The detail on display is undeniably extraordinary: from the satellite data alone, radar points highlight individual statues and lampposts. The researchers could even see how buildings expanded and contracted in response to seasonal weather changes. “We are getting, in the end, a point cloud with a density of one million points per square kilometer,” Zhu said.

Berlin, as captured by radar tomography. Image courtesy of Xiaoxiang Zhu.

Combining this point cloud with the building footprints, they got building maps, complete with elevation by building. To start, the researchers worked with major cities, which offered points of comparison for validating their work. After comparing their results for 30,000 buildings with precise lidar data for the same buildings, the researchers found the height estimation to be “better than two meters.”

“For Europe, this is probably nothing really breathtaking,” Zhu said – but for areas without even building footprints available, it was something else entirely.

As of the keynote, Zhu said that the researchers had already processed more than 1,700 cities, including all cities with populations over 300,000. To complete the radar tomography globally, she said, “we can use the same technique, but we need ten times the data.”

Throughout the talk, Zhu referred back to the UN’s Sustainable Development Goals, a set of 17 objectives set forth in 2015 that range from ending hunger to ensuring affordable and clean energy. This work, for Zhu, falls under the first goal (“no poverty”) and the eleventh (“sustainable cities and communities”).

“We are making this data open and free,” she said. “And we are hoping, by providing this information, we could contribute[.]”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Why HPC Storage Matters More Now Than Ever: Analyst Q&A

September 17, 2021

With soaring data volumes and insatiable computing driving nearly every facet of economic, social and scientific progress, data storage is seizing the spotlight. Hyperion Research analyst and noted storage expert Mark No Read more…

GigaIO Gets $14.7M in Series B Funding to Expand Its Composable Fabric Technology to Customers

September 16, 2021

Just before the COVID-19 pandemic began in March 2020, GigaIO introduced its Universal Composable Fabric technology, which allows enterprises to bring together any HPC and AI resources and integrate them with networking, Read more…

What’s New in HPC Research: Solar Power, ExaWorks, Optane & More

September 16, 2021

In this regular feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

Cerebras Brings Its Wafer-Scale Engine AI System to the Cloud

September 16, 2021

Five months ago, when Cerebras Systems debuted its second-generation wafer-scale silicon system (CS-2), co-founder and CEO Andrew Feldman hinted of the company’s coming cloud plans, and now those plans have come to fruition. Today, Cerebras and Cirrascale Cloud Services are launching... Read more…

AI Hardware Summit: Panel on Memory Looks Forward

September 15, 2021

What will system memory look like in five years? Good question. While Monday's panel, Designing AI Super-Chips at the Speed of Memory, at the AI Hardware Summit, tackled several topics, the panelists also took a brief glimpse into the future. Unlike compute, storage and networking, which... Read more…

AWS Solution Channel

Supporting Climate Model Simulations to Accelerate Climate Science

The Amazon Sustainability Data Initiative (ASDI), AWS is donating cloud resources, technical support, and access to scalable infrastructure and fast networking providing high performance computing (HPC) solutions to support simulations of near-term climate using the National Center for Atmospheric Research (NCAR) Community Earth System Model Version 2 (CESM2) and its Whole Atmosphere Community Climate Model (WACCM). Read more…

ECMWF Opens Bologna Datacenter in Preparation for Atos Supercomputer

September 14, 2021

In January 2020, the European Centre for Medium-Range Weather Forecasts (ECMWF) – a juggernaut in the weather forecasting scene – signed a four-year, $89-million contract with European tech firm Atos to quintuple its supercomputing capacity. With the deal approaching the two-year mark, ECMWF... Read more…

Why HPC Storage Matters More Now Than Ever: Analyst Q&A

September 17, 2021

With soaring data volumes and insatiable computing driving nearly every facet of economic, social and scientific progress, data storage is seizing the spotlight Read more…

Cerebras Brings Its Wafer-Scale Engine AI System to the Cloud

September 16, 2021

Five months ago, when Cerebras Systems debuted its second-generation wafer-scale silicon system (CS-2), co-founder and CEO Andrew Feldman hinted of the company’s coming cloud plans, and now those plans have come to fruition. Today, Cerebras and Cirrascale Cloud Services are launching... Read more…

AI Hardware Summit: Panel on Memory Looks Forward

September 15, 2021

What will system memory look like in five years? Good question. While Monday's panel, Designing AI Super-Chips at the Speed of Memory, at the AI Hardware Summit, tackled several topics, the panelists also took a brief glimpse into the future. Unlike compute, storage and networking, which... Read more…

ECMWF Opens Bologna Datacenter in Preparation for Atos Supercomputer

September 14, 2021

In January 2020, the European Centre for Medium-Range Weather Forecasts (ECMWF) – a juggernaut in the weather forecasting scene – signed a four-year, $89-million contract with European tech firm Atos to quintuple its supercomputing capacity. With the deal approaching the two-year mark, ECMWF... Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

Amazon, NCAR, SilverLining Team for Unprecedented Cloud Climate Simulations

September 10, 2021

Earth’s climate is, to put it mildly, not in a good place. In the wake of a damning report from the Intergovernmental Panel on Climate Change (IPCC), scientis Read more…

After Roadblocks and Renewals, EuroHPC Targets a Bigger, Quantum Future

September 9, 2021

The EuroHPC Joint Undertaking (JU) was formalized in 2018, beginning a new era of European supercomputing that began to bear fruit this year with the launch of several of the first EuroHPC systems. The undertaking, however, has not been without its speed bumps, and the Union faces an uphill... Read more…

How Argonne Is Preparing for Exascale in 2022

September 8, 2021

Additional details came to light on Argonne National Laboratory’s preparation for the 2022 Aurora exascale-class supercomputer, during the HPC User Forum, held virtually this week on account of pandemic. Exascale Computing Project director Doug Kothe reviewed some of the 'early exascale hardware' at Argonne, Oak Ridge and NERSC (Perlmutter), while Ti Leggett, Deputy Project Director & Deputy Director... Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer called Dojo to process truly vast amounts of video data. It’s a beast! … A truly useful exaflop at de facto FP32.” Read more…

Berkeley Lab Debuts Perlmutter, World’s Fastest AI Supercomputer

May 27, 2021

A ribbon-cutting ceremony held virtually at Berkeley Lab's National Energy Research Scientific Computing Center (NERSC) today marked the official launch of Perlmutter – aka NERSC-9 – the GPU-accelerated supercomputer built by HPE in partnership with Nvidia and AMD. Read more…

Google Launches TPU v4 AI Chips

May 20, 2021

Google CEO Sundar Pichai spoke for only one minute and 42 seconds about the company’s latest TPU v4 Tensor Processing Units during his keynote at the Google I Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. “We’ve been scaling our neural network training compute dramatically over the last few years,” said Milan Kovac, Tesla’s director of autopilot engineering. Read more…

CentOS Replacement Rocky Linux Is Now in GA and Under Independent Control

June 21, 2021

The Rocky Enterprise Software Foundation (RESF) is announcing the general availability of Rocky Linux, release 8.4, designed as a drop-in replacement for the soon-to-be discontinued CentOS. The GA release is launching six-and-a-half months after Red Hat deprecated its support for the widely popular, free CentOS server operating system. The Rocky Linux development effort... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Iran Gains HPC Capabilities with Launch of ‘Simorgh’ Supercomputer

May 18, 2021

Iran is said to be developing domestic supercomputing technology to advance the processing of scientific, economic, political and military data, and to strengthen the nation’s position in the age of AI and big data. On Sunday, Iran unveiled the Simorgh supercomputer, which will deliver.... Read more…

Leading Solution Providers

Contributors

AMD-Xilinx Deal Gains UK, EU Approvals — China’s Decision Still Pending

July 1, 2021

AMD’s planned acquisition of FPGA maker Xilinx is now in the hands of Chinese regulators after needed antitrust approvals for the $35 billion deal were receiv Read more…

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

Quantum Roundup: IBM, Rigetti, Phasecraft, Oxford QC, China, and More

July 13, 2021

IBM yesterday announced a proof for a quantum ML algorithm. A week ago, it unveiled a new topology for its quantum processors. Last Friday, the Technical Univer Read more…

Frontier to Meet 20MW Exascale Power Target Set by DARPA in 2008

July 14, 2021

After more than a decade of planning, the United States’ first exascale computer, Frontier, is set to arrive at Oak Ridge National Laboratory (ORNL) later this year. Crossing this “1,000x” horizon required overcoming four major challenges: power demand, reliability, extreme parallelism and data movement. Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire