Researchers Peer into Dark Matter with MillenniumTNG Simulation

November 21, 2023

Nov. 21, 2023 — A research collaboration including a team based at the Max Planck Institute for Astrophysics has long leveraged world-class supercomputing resources to understand how our universe came to exist in its current form. Building on the successes of the previous “Millennium,” “Illustris,” and “IllustrisTNG” projects, the researchers are simulating dark matter in unprecedented detail in the context of the “MillenniumTNG” project.

This image shows neutrinos (top) and dark matter density fields (bottom) from a fixed observation point. The MillenniumTNG simulations are allowing researchers to better model and, in turn, understand the ubiquitous yet mysterious neutrinos in our universe. Image credit: Volker Springel and the MillenniumTNG collaboration.

In recent decades, a mix of technological advancements in observational facilities as well as computational power have ushered in an exciting, productive period for astrophysicists and cosmologists. Among the countless new theories and observations collected during this period, perhaps none has more fundamentally reshaped thinking about how our universe functions than the hypothesis that a mysterious form of matter called dark matter dominates the universe, making up a much larger percentage of matter in the universe than the so-called baryonic matter that comprises planets, stars, and living beings here on Earth.

A team of researchers led by Prof. Dr. Volker Springel of the Max Planck Institute of Astrophysics seeks to better understand both the origins of our universe as well as how materials spread throughout it today, as cosmologists must spend more effort understanding dark matter’s behavior and characteristics.

The team is well-equipped to probe the cutting edge of cosmology research: as part of the Millennium, Illustris, and IllustrisTNG consortia, it has worked for years on developing cosmological simulations on world-class high-performance computing (HPC) resources. The team has long turned to the Leibniz Supercomputing Centre (LRZ) in Garching near Munich in support of their simulation efforts. Recently, the researchers have used LRZ’s flagship supercomputer, SuperMUC-NG, as part of the next iteration of this research collaboration, the MillenniumTNG project, named as a nod to its predecessor projects and the insight they have provided for the team’s ambitious efforts to better understand dark matter.

“Our new project combines both approaches from previous work,” Springel said. “We have a simulation suite, which includes a very large hydrodynamics simulation like we did in the IllustrisTNG project, but at bigger volume. Then the Millenium simulation, which was done all the way back in 2005, gave us the ability to map out the cosmic web very well and analytically predict galaxy formation on top of it for an area of 500 megaparsecs cubed. 20 years later, we are now at the stage where we can do this very large volume that we did for the Millenium simulations, but with full physics included in the simulation.”

Over 700 papers have been published connected to the simulations done as part of this chain of successor projects. With MillenniumTNG, the team created the largest simulation of dark matter of its kind, and recently published a series of 10 articles in the Monthly Notices of the Royal Astronomical Society.

Dark Matter Comes Into View

For the MillenniumTNG project, Springel and his collaborators designed a computational approach that could facilitate a full-physics simulation of a large slice of the universe, but their goal was to focus on better understanding dark matter’s influence on celestial bodies and materials moving through galaxies. In order to represent galaxy formation as accurately as they had in previous work, the team used its in-house AREPO code for accurately representing the complex hydrological dynamics in play during galaxy formation. The researchers also developed a new code, GADGET-4, that focused on high-resolution simulations of dark matter. For the first time, the team also included massive neutrinos in its simulations. Neutrinos are also known as “ghost particles,” because they are the most numerous particles in the known universe, yet they are so small and neutral in their interactions with other particles that scientists have been unable to accurately measure their mass. To create a hyper-realistic view of the universe, researchers must model neutrinos as part of their simulations.

The team was able to accurately simulate dark matter in a computational cube that is roughly 10 billion lightyears across. By adding in neutrinos, the researchers created a model of galaxies so large that they can extrapolate how effects seen in their simulation can impact the universe as a whole.

When simulations such as those running as part of MillenniumTNG work in tandem with next-generation experimental resources, such as the European Space Agency’s Euclid satellite, they provide cosmologists a powerful tandem of tools to answer burning questions in the field and bring scientists closer to measuring the mass of elusive neutrinos.

With our new simulation suite, we are able to develop new ways to test the influence of neutrinos on cosmological structures,” Springel said. “Then we can develop new observational probes or advise which probes to use by demonstrating their accuracy with simulations.”

Increased Computing Power Unlocks New Details in Cosmological Models

For the MillenniumTNG simulations, the team used 122,880 of SuperMUC-NG’s computational cores to run its record-breaking simulations. While it focused on dark matter for the simulation, the team also included an analytical model that allowed for accurate rendering of galaxies and matter moving throughout the universe. By simulating such a large volume, the team feels confident in using these simulations as a direct comparison with new observational data.

Springel and his collaborators have worked closely with LRZ staff over the years to refine and optimize code performance on SuperMUC-NG, and LRZ has ensured that the team has been able to access large amounts of the machine at once for its demanding calculations.

The team has refined its computational approach over many years and is a voracious user of computing time. Moving forward in the MillenniumTNG project, it plans to leverage increased computing power to include even more detail in its simulations. Specifically, it hopes to add cosmic rays—high-energy particles racing through the universe at light speed—into the simulation suite. In addition, next-generation computing power will allow the team to include a host of complex physics in play for celestial bodies and interstellar materials in close proximity to black holes.

Between the power and promise of next-generation HPC systems and the increased insight offered by new observational tools, the team feels confident that MillenniumTNG will follow its parent projects to fascinate and challenge cosmologists around the world in their search for further insights.

This article originally appeared in the Autumn 2023 issue of InSiDE magazine.


Source: Eric Gedenk, Gauss Centre for Supercomputing

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket for an optional 8087 math coprocessor. The math coprocessor ma Read more…

IonQ Reports Advance on Path to Networked Quantum Computing

February 22, 2024

IonQ reported reaching a milestone in its efforts to use entangled photon-ion connectivity to scale its quantum computers. IonQ’s quantum computers are based on trapped ions which feature long coherence times and qubit Read more…

Apple Rolls out Post Quantum Security for iOS

February 21, 2024

Think implementing so-called Post Quantum Cryptography (PQC) isn't important because quantum computers able to decrypt current RSA codes don’t yet exist? Not Apple. Today the consumer electronics giant started rolling Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to derive any substantial value from it. However, the GenAI hyp Read more…

QED-C Issues New Quantum Benchmarking Paper

February 20, 2024

The Quantum Economic Development Consortium last week released a new paper on benchmarking – Quantum Algorithm Exploration using Application-Oriented Performance Benchmarks – that builds on earlier work and is an eff Read more…

AWS Solution Channel

Shutterstock 2283618597

Deep-dive into Ansys Fluent performance on Ansys Gateway powered by AWS

Today, we’re going to deep-dive into the performance and associated cost of running computational fluid dynamics (CFD) simulations on AWS using Ansys Fluent through the Ansys Gateway powered by AWS (or just “Ansys Gateway” for the rest of this post). Read more…

Atom Computing Reports Advance in Scaling Up Neutral Atom Qubit Arrays

February 15, 2024

The scale-up challenge facing quantum computing (QC) is daunting and varied. It’s commonly held that 1 million qubits (or more) will be needed to deliver practical fault tolerant QC. It’s also a varied challenge beca Read more…

A Big Memory Nvidia GH200 Next to Your Desk: Closer Than You Think

February 22, 2024

Students of the microprocessor may recall that the original 8086/8088 processors did not have floating point units. The motherboard often had an extra socket fo Read more…

Apple Rolls out Post Quantum Security for iOS

February 21, 2024

Think implementing so-called Post Quantum Cryptography (PQC) isn't important because quantum computers able to decrypt current RSA codes don’t yet exist? Not Read more…

QED-C Issues New Quantum Benchmarking Paper

February 20, 2024

The Quantum Economic Development Consortium last week released a new paper on benchmarking – Quantum Algorithm Exploration using Application-Oriented Performa Read more…

The Pulse of HPC: Tracking 4.5 Million Heartbeats of 3D Coronary Flow

February 15, 2024

Working in Duke University's Randles Lab, Cyrus Tanade, a National Science Foundation graduate student fellow and Ph.D. candidate in biomedical engineering, is Read more…

It Doesn’t Get Much SWEETER: The Winter HPC Computing Festival in Corpus Christi

February 14, 2024

(Main Photo by Visit Corpus Christi CrowdRiff) Texas A&M University's High-Performance Research Computing (HPRC) team hosted the "SWEETER Winter Comput Read more…

Q-Roundup: Diraq’s War Chest, DARPA’s Bet on Topological Qubits, Citi/Classiq Explore Optimization, WEF’s Quantum Blueprint

February 13, 2024

Yesterday, Australian start-up Diraq added $15 million to its war chest (now $120 million) to build a fault tolerant computer based on quantum dots. Last week D Read more…

2024 Winter Classic: Razor Thin Margins in HPL/HPCG

February 12, 2024

The first task for the 11 teams in the 2024 Winter Classic student cluster competition was to run and optimize the LINPACK and HPCG benchmarks. As usual, the Read more…

2024 Winter Classic: We’re Back!

February 9, 2024

The fourth edition of the Winter Classic Invitational Student Cluster Competition is up and running. This year, we have 11 teams of eager students representin Read more…

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire