Sept. 27, 2021 — Exascale is heralded as a major breakthrough in computing that will pave the way for excellence in science and engineering, machine learning, and artificial intelligence. Its realization comes with a cohort of challenges, especially in processing and managing extremely large data sets. The legacy flat storage systems on classic HPC architectures are no longer capable of dealing with the emerging data-intensive computing requirements of applications. To address these concerns, hierarchical storage systems have been developed to balance computation and storage performance. However, there is still a need for adequate software interfaces which can leverage these HPC I/O architectures.
It is in this area that the ADMIRE project (Adaptive Multi-tier Intelligent Data Manager for Exascale) will play a key role by creating an active I/O stack that exploits all layers of HPC I/O. This will be achieved by implementing an intelligent global coordination mechanism, malleability of computation and I/O, and the integrated scheduling of storage resources. An operational software-defined framework will be developed based on scalable monitoring and control, with aligned control and data paths as well as embedded control points which orchestrate the system components and applications. The envisioned framework will be co-designed by the project partners with several use cases from diverse scientific areas, including climate/weather, life sciences, remote sensing, software heritage, and deep learning.
ADMIRE is coordinated by Universidad Carlos III de Madrid (Spain). Jülich Supercomputing Centre will contribute to the work packages “Application Co-Design” (WP7), “Intelligent Controller” (WP6), and “Dissemination and Exploitation” (WP8). JSC is the lead partner for WP7, which will produce an enhanced version of the existing applications based on the co-design methodology developed during the project lifetime. ADMIRE is funded through the EuroHPC Joint Undertaking and is co-funded by the German Ministry for Education and Research (BMBF).
ADMIRE is a European-funded project with a budget of €7.9M that started on 1st April 2021 and will last for three years. Coordinated by UC3M (Spain), the project brings together a multidisciplinary consortium: BSC (Spain), JGU (Germany), TUDA (Germany), MPG (Germany), FZJ (Germany), DDN (France), Paratools (France), INRIA (France), CINI (Italy), CINECA (Italy), E4 (Italy), PSNC (Poland), and KTH (Sweden). The ADMIRE project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 956748. The JU receives support from the European Union’s Horizon 2020 research and innovation program and Spain, Germany, France, Italy, Poland, and Sweden.
Source:Jülich Supercomputing Centre, ADMIRE