Open-Source Supercomputer Code WarpX Presents Path for Shrinking Particle Accelerators

March 19, 2021

March 19, 2021 — When we think of the particle accelerators that elucidate the building blocks of nature, we think of spectacular and massive facilities like the 27-kilometer-circumference Large Hadron Collider (LHC), the proton-crashing instrument at CERN famous for the Higgs boson discovery.

But what if there were much smaller alternatives to the giant machines that could probe physics beyond the large colliders’ reach? There just may be such a possibility: laser-plasma accelerators, “a promising candidate to significantly reduce the cost and improve the compactness of beam generators,” says Jean-Luc Vay, a senior physicist at Lawrence Berkeley National Laboratory and head of the Accelerator Modeling Program in the lab’s Accelerator Technology and Applied Physics Division.

Envisioned since the late 1970s, laser-based devices that boost charged particles to near-light speed could be tens to hundreds of times smaller than current machines. With these small, affordable particle accelerators, scientists could conduct experiments on subatomic particles by accelerating particle beams in much shorter distances than now. In addition, by generating extremely intense bursts of light – with remarkable physical systems called plasma mirrors – researchers could explore quantum electrodynamic phenomena beyond the reach of even the biggest particle accelerators like LHC, including neutron stars, black-hole horizons and other violent astrophysical events.

To help develop these futuristic devices, teams led by Vay and Henri Vincenti, a research scientist at France’s Commissariat à l’Energie Atomique (CEA), Université Paris-Saclay, have developed WarpX, an open-source code that simulates plasmas produced when high-powered lasers fire into solids or gases. “In this context,” Vincenti says, “our work consists in using massively parallel simulations to find realistic experimental schemes based on high-intensity laser-plasma interactions.” These designs could help generate relativistic particle beams – fermions, hadrons – with properties at least as good as those from conventional accelerators.

A snapshot from a three-dimensional WarpX simulation of a laser-driven plasma accelerator. The laser (red) propagates to create a plasma wake (yellow and blue) that accelerates a small electron beam (white) to high energy. A mesh refinement patch (green box) increases the resolution and improves the accuracy around the electron beam. Image courtesy of Lawrence Berkeley National Laboratory.

The team has developed WarpX through the Department of Energy (DOE) Exascale Computing Project (ECP). EPC has paved the way for the next generation of high-performance computers, which will be able to conduct one million trillion operations per second. The name WarpX is a combination of “X” for exascale and “warp,” a previous-version code name derived from “warp speed,” the science-fiction concept of faster-than-light travel.

Vay, Vincenti and their colleagues have received a renewal allocation of computing time through DOE’s Innovative and Novel Computational Impact on Theory and Experiment (INCITE) program. The award includes 110,000 node-hours on Summit, Oak Ridge National Laboratory’s IBM AC922 machine, and 600,000 node-hours on Theta, a Cray XC40 machine at Argonne National Laboratory. Summit is the United States’ most powerful high-performance computer, running primarily on graphics processing units (GPUs), and Theta is one of the biggest machines driven by central processing units (CPUs). “Our code was first targeted at CPUs and ported to GPUs recently,” Vay says. “As we are moving to using GPUs routinely for production, Theta provides an excellent platform during the transition.”

The INCITE award lets the team explore an effect that can occur when a high-powered laser hits a silica plate. Under the right conditions, silicon ions and electrons are torn from the plate’s surface to form a dense plasma that behaves like a parabolic mirror, or a relativistic plasma mirror, that reflects charged particles at velocities approaching the speed of light. The team will simulate the use of such a mirror to inject electron bunches into high-powered laser beams capable of further accelerating the electrons over distances that are tens to thousands of times shorter than those which conventional accelerators use. Vay says compact electron accelerators could lead to applications in high-energy physics, particle therapy, sterilization of equipment and liquids, materials science, chemistry, biology and pharmacology.

The team also is exploring using relativistic plasma mirrors to produce extreme light intensities. WarpX simulations already have shown that these mirrors could focus light to intensities more than a thousand times greater than today’s most powerful lasers. In optimal laser-plasma conditions, such devices could potentially achieve intensities close to the so-called Schwinger limit, where the quantum vacuum becomes unstable, leading to copious production of electron-positron pairs. Scientists are eager to study such phenomena further because they occur in mysterious, violent astrophysical events such as gamma-ray bursts.

The team faces several challenges in developing WarpX. As a particle-in-cell code, it describes plasma as a mesh of cells, each populated with data describing the plasma inside. Besides temperature, velocity and electromagnetic charge, the code captures a staggering range of time and space scales. Vital events may take a few quadrillionths of a second while others, in the same simulation, can take microseconds. With some events taking one billionth the length of others, the challenge is the equivalent of tracking every second of a 31-year-old person’s life. The lengths also can expand to 1 billion. Modeling micron laser wavelengths in a 1-kilometer accelerator is akin to shrinking the border between California and Nevada down to a millimeter.

This extreme scope makes simulations especially challenging. The team is pioneering ways to apply Maxwell’s equations, which govern how electromagnetic waves (such as lasers) interact with matter, and Lorentz transformations, which slip simulated objects (like ions or electrons) traveling near the speed of light from one type of mathematical grid to another.

The WarpX team’s greatest challenge is to implement these advanced features while developing an ability to focus on simulation events at virtually any level of detail. The goal is to use WarpX to zoom in on the small events and short time scales through adaptive mesh refinement, which works out details in one part of a simulation without crunching the numbers for the full simulation. Here the team also draws on DOE’s AMReX code library, developed through the ECP at Berkeley Lab, Argonne and the National Renewable Energy Laboratory in Golden, Colorado.

“Mesh refinement is particularly difficult to implement in an electromagnetic particle-in-cell code,” Vay says. “There are many numerical issues that need to be addressed. We have studied, and are continuing to study, the various numerical issues at hand independently, and we have developed mitigation strategies. Tests are scheduled to assess the overall performance once all the pieces are in place.”


Source: US DOE ASCR Discovery

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Supercomputer-Powered Climate Model Makes Startling Sea Level Rise Prediction

April 19, 2021

The climate science community is tasked with striking a difficult balance: inspiring precisely the amount of alarm commensurate to the climate crisis. Make estimates that are too conservative, and the public might not re Read more…

San Diego Supercomputer Center Opens ‘Expanse’ to Industry Users

April 15, 2021

When San Diego Supercomputer Center (SDSC) at the University of California San Diego was getting ready to deploy its flagship Expanse supercomputer for the large research community it supports, it also sought to optimize Read more…

GTC21: Dell Building Cloud Native Supercomputers at U Cambridge and Durham

April 14, 2021

In conjunction with GTC21, Dell Technologies today announced new supercomputers at universities across DiRAC (Distributed Research utilizing Advanced Computing) in the UK with plans to explore use of Nvidia BlueField DPU technology. The University of Cambridge will expand... Read more…

The Role and Potential of CPUs in Deep Learning

April 14, 2021

Deep learning (DL) applications have unique architectural characteristics and efficiency requirements. Hence, the choice of computing system has a profound impact on how large a piece of the DL pie a user can finally enj Read more…

GTC21: Nvidia Launches cuQuantum; Dips a Toe in Quantum Computing

April 13, 2021

Yesterday Nvidia officially dipped a toe into quantum computing with the launch of cuQuantum SDK, a development platform for simulating quantum circuits on GPU-accelerated systems. As Nvidia CEO Jensen Huang emphasized in his keynote, Nvidia doesn’t plan to build... Read more…

AWS Solution Channel

Research computing with RONIN on AWS

To allow more visibility into and management of Amazon Web Services (AWS) resources and expenses and minimize the cloud skills training required to operate these resources, AWS Partner RONIN created the RONIN research computing platform. Read more…

Nvidia Aims Clara Healthcare at Drug Discovery, Imaging via DGX

April 12, 2021

Nvidia Corp. continues to expand its Clara healthcare platform with the addition of computational drug discovery and medical imaging tools based on its DGX A100 platform, related InfiniBand networking and its AGX developer kit. The Clara partnerships announced during... Read more…

San Diego Supercomputer Center Opens ‘Expanse’ to Industry Users

April 15, 2021

When San Diego Supercomputer Center (SDSC) at the University of California San Diego was getting ready to deploy its flagship Expanse supercomputer for the larg Read more…

GTC21: Dell Building Cloud Native Supercomputers at U Cambridge and Durham

April 14, 2021

In conjunction with GTC21, Dell Technologies today announced new supercomputers at universities across DiRAC (Distributed Research utilizing Advanced Computing) in the UK with plans to explore use of Nvidia BlueField DPU technology. The University of Cambridge will expand... Read more…

The Role and Potential of CPUs in Deep Learning

April 14, 2021

Deep learning (DL) applications have unique architectural characteristics and efficiency requirements. Hence, the choice of computing system has a profound impa Read more…

GTC21: Nvidia Launches cuQuantum; Dips a Toe in Quantum Computing

April 13, 2021

Yesterday Nvidia officially dipped a toe into quantum computing with the launch of cuQuantum SDK, a development platform for simulating quantum circuits on GPU-accelerated systems. As Nvidia CEO Jensen Huang emphasized in his keynote, Nvidia doesn’t plan to build... Read more…

Nvidia Aims Clara Healthcare at Drug Discovery, Imaging via DGX

April 12, 2021

Nvidia Corp. continues to expand its Clara healthcare platform with the addition of computational drug discovery and medical imaging tools based on its DGX A100 platform, related InfiniBand networking and its AGX developer kit. The Clara partnerships announced during... Read more…

Nvidia Serves Up Its First Arm Datacenter CPU ‘Grace’ During Kitchen Keynote

April 12, 2021

Today at Nvidia’s annual spring GPU Technology Conference (GTC), held virtually once more due to the pandemic, the company unveiled its first ever Arm-based CPU, called Grace in honor of the famous American programmer Grace Hopper. The announcement of the new... Read more…

Nvidia Debuts BlueField-3 – Its Next DPU with Big Plans for an Expanded Role

April 12, 2021

Nvidia today announced its next generation data processing unit (DPU) – BlueField-3 – adding more substance to its evolving concept of the DPU as a full-fledged partner to CPUs and GPUs in delivering advanced computing. Nvidia is pitching the DPU as an active engine... Read more…

Nvidia’s Newly DPU-Enabled SuperPod Is a Multi-Tenant, Cloud-Native Supercomputer

April 12, 2021

At GTC 2021, Nvidia has announced an upgraded iteration of its DGX SuperPods, calling the new offering “the first cloud-native, multi-tenant supercomputer.” Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

Intel Launches 10nm ‘Ice Lake’ Datacenter CPU with Up to 40 Cores

April 6, 2021

The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more…

CERN Is Betting Big on Exascale

April 1, 2021

The European Organization for Nuclear Research (CERN) involves 23 countries, 15,000 researchers, billions of dollars a year, and the biggest machine in the worl Read more…

Programming the Soon-to-Be World’s Fastest Supercomputer, Frontier

January 5, 2021

What’s it like designing an app for the world’s fastest supercomputer, set to come online in the United States in 2021? The University of Delaware’s Sunita Chandrasekaran is leading an elite international team in just that task. Chandrasekaran, assistant professor of computer and information sciences, recently was named... Read more…

HPE Launches Storage Line Loaded with IBM’s Spectrum Scale File System

April 6, 2021

HPE today launched a new family of storage solutions bundled with IBM’s Spectrum Scale Erasure Code Edition parallel file system (description below) and featu Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Saudi Aramco Unveils Dammam 7, Its New Top Ten Supercomputer

January 21, 2021

By revenue, oil and gas giant Saudi Aramco is one of the largest companies in the world, and it has historically employed commensurate amounts of supercomputing Read more…

Quantum Computer Start-up IonQ Plans IPO via SPAC

March 8, 2021

IonQ, a Maryland-based quantum computing start-up working with ion trap technology, plans to go public via a Special Purpose Acquisition Company (SPAC) merger a Read more…

Leading Solution Providers

Contributors

Can Deep Learning Replace Numerical Weather Prediction?

March 3, 2021

Numerical weather prediction (NWP) is a mainstay of supercomputing. Some of the first applications of the first supercomputers dealt with climate modeling, and Read more…

Livermore’s El Capitan Supercomputer to Debut HPE ‘Rabbit’ Near Node Local Storage

February 18, 2021

A near node local storage innovation called Rabbit factored heavily into Lawrence Livermore National Laboratory’s decision to select Cray’s proposal for its CORAL-2 machine, the lab’s first exascale-class supercomputer, El Capitan. Details of this new storage technology were revealed... Read more…

New Deep Learning Algorithm Solves Rubik’s Cube

July 25, 2018

Solving (and attempting to solve) Rubik’s Cube has delighted millions of puzzle lovers since 1974 when the cube was invented by Hungarian sculptor and archite Read more…

African Supercomputing Center Inaugurates ‘Toubkal,’ Most Powerful Supercomputer on the Continent

February 25, 2021

Historically, Africa hasn’t exactly been synonymous with supercomputing. There are only a handful of supercomputers on the continent, with few ranking on the Read more…

AMD Launches Epyc ‘Milan’ with 19 SKUs for HPC, Enterprise and Hyperscale

March 15, 2021

At a virtual launch event held today (Monday), AMD revealed its third-generation Epyc “Milan” CPU lineup: a set of 19 SKUs -- including the flagship 64-core, 280-watt 7763 part --  aimed at HPC, enterprise and cloud workloads. Notably, the third-gen Epyc Milan chips achieve 19 percent... Read more…

The History of Supercomputing vs. COVID-19

March 9, 2021

The COVID-19 pandemic poses a greater challenge to the high-performance computing community than any before. HPCwire's coverage of the supercomputing response t Read more…

HPE Names Justin Hotard New HPC Chief as Pete Ungaro Departs

March 2, 2021

HPE CEO Antonio Neri announced today (March 2, 2021) the appointment of Justin Hotard as general manager of HPC, mission critical solutions and labs, effective Read more…

Microsoft, HPE Bringing AI, Edge, Cloud to Earth Orbit in Preparation for Mars Missions

February 12, 2021

The International Space Station will soon get a delivery of powerful AI, edge and cloud computing tools from HPE and Microsoft Azure to expand technology experi Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire