SAN FRANCISCO, Dec. 15, 2020 – In an invited paper at IEDM 2020, CEA-List and CEA-Leti, research institutes at CEA, presented their technologies for achieving exascale-level, high- performance computing (HPC).
Highlighting CEA-Leti’s state-of-the-art, 3D-technology toolbox and CEA-List’s advanced demonstrators that together enable higher bandwidth and heterogeneity for processors, the paper explains architectural and performance advances and describes how 3D-integration technologies allow heterogeneity and increased bandwidth that are critical for hardware innovations that help enable exascale computing.
“Profound evolutions brought by high performance computing (HPC) applications are based on continuous and exponential increases in computing performances over the past decades,” explained the paper, How 3D integration technologies enable advanced compute node for Exascale-level High Performance Computing?. “Supercomputers will soon achieve exascale-level computing performances mainly thanks to the introduction of innovative hardware technologies around the processors.”
Exascale computing refers to computing systems capable of calculating at least 10¹⁸, or one-billion-billion, floating-point operations per second, which would be twice as fast as the fastest computer available today.
Efforts to develop exascale computing are driven by highly data-intensive scientific and industrial applications, such as climate research, drug discovery and material design. This level of performance in HPC and Big Data will be achieved with heterogeneous computing nodes composed of generic processor chiplets hosting accelerator chiplets for improved operational intensity.
The CEA technologies presented in the paper are powering demonstrators in the ExaNoDe and INTACT projects, which have developed integrated prototypes with technology building blocks to support the EU’s drive towards exascale computing. The two institutes combined CEA-Leti’s expertise in silicon and 3D sequential integration with CEA-List’s many-core architectures, which are differentiated by their high level of scalability and power efficiency. They have demonstrated the benefit of new integration methods and processes following two main paths: finer 3D interconnect pitches, leading to improved bandwidth between compute chiplets, and assembly technologies that allow increasing heterogeneity in packaging, which improves peak performance.
In addition, the importance of a 3D-integration solution to developing HPC processors is confirmed by the European Processor Initiative (EPI), with which CEA is deeply involved. Its aim is to design and implement a roadmap for a new family of low-power European processors for extreme scale computing, high-performance Big Data and a range of emerging applications.
“These R&D successes open a path towards heterogeneous processors that will enable exascale-level supercomputers,” said Denis Dutoit, a CEA-List scientist and lead author of the IEDM paper. “We demonstrated that co-optimization of advanced architectures with 3D integration technologies achieves the level of computing performance and bandwidth required for HPC.”
Because chiplets stacked on active interposer allow modularity and reusability at low development costs, CEA-List also is investigating using this new methodology for HPC architectures in the embedded world, for compute-intensive accelerators. For edge applications requiring a high level of computation and memory, such as artificial intelligence (AI), chiplet-based partitioning will enable the creation of a broad range of solutions to meet the needs for embedded AI. Potential uses include autonomous driving, transport applications and industry 4.0.
Current CEA-Leti research work addresses die-to-wafer direct hybrid-bonding technology, which offers denser 3D interconnects with better electrical, mechanical and thermal parameters, and allows ultrahigh-bandwidth capabilities in heterogeneous systems. CEA-Leti also is working on high-density through silicon vias (TSV) (pitch 1 to 4 µms) to create together with die-to-wafer hybrid bonding a complete dense 3D stack. For the longer term, CEA-Leti is also investigating innovative photonic-interposer technology as a 3D-based photonic chiplet approach to enable interconnection of tens of computing chiplets with the resulting chip-to-chip communication bandwidth, latency and energy.
Over the next decade, co-optimization of advanced integration technologies with disruptive architectures is expected to establish the key foundations for HPC components.
This work was funded by the French National Programme d’Investissements d’Avenir (Investments in the Future), IRT Nanoelec, under Grant ANR-10-AIRT-05.
This work also was supported by the ExaNoDe project, funded by the European Union’s H2020 program under grant agreement No. 671578.
CEA is a public research organisation working in four sectors: defence and security, nuclear and renewable energy, technological research for industries and fundamental research. Supported by a well-known expertise, CEA participated in the implementation of collaboration project with numerous academic and industrial partners. With 16,000 researchers and collaborators, it is a major European player in research and is increasingly present at international level.
A CEA technology research institute,CEA-List dedicates its activity to smart digital systems. Its R&D programs focus on artificial intelligence, advanced manufacturing, cyber-physical systems and digital health. Based in Paris-Saclay and Grenoble, the CEA List’s 900 engineer-researchers and technicians put their skills and expertise at the service of major socio-economic issues by offering companies high-added-value technological innovations, centered on people and carrying values of social and environmental responsibility. CEA-List has launched 25 startups and is a member of the Carnot Institutes network. Follow us on www-list.cea.fr/en | @CEA_List | LinkedIn | YouTube.
A CEA technology research institute,CEA-Leti is a global leader in miniaturization technologies enabling smart, energy-efficient and secure solutions for industry. Founded in 1967, CEA-Leti pioneers micro-& nanotechnologies, tailoring differentiating applicative solutions for global companies, SMEs and startups. CEA-Leti tackles critical challenges in healthcare, energy and digital migration. From sensors to data processing and computing solutions, CEA-Leti’s multidisciplinary teams deliver solid expertise, leveraging world-class pre-industrialization facilities. With a staff of more than 1,900, a portfolio of 3,100 patents, 10,000 sq. meters of cleanroom space and a clear IP policy, the institute is based in Grenoble, France, and has offices in Silicon Valley and Tokyo. CEA-Leti has launched 65 startups and is a member of the Carnot Institutes network. Follow us on www.leti-cea.com and @CEA_Leti.