How the US Could Achieve Superconducting Supercomputing in Five Years

By Tiffany Trader

December 9, 2014

The Intelligence Advanced Research Projects Activity (IARPA) has officially commenced a multi-year research effort to develop a superconducting computer as a long-term solution to the power, cooling and space constraints that afflict modern high-performance computing. First revealed in February 2013, when the agency put out a call for proposals, the Cryogenic Computer Complexity (C3) program aims to pave the way for a new generation of superconducting supercomputers that are far more energy efficient than machines based on complementary metal oxide semiconductor (CMOS) technology.

Studies indicate the technology, which uses low temperatures in the 4-10 kelvin range to enable information to be transmitted with minimal energy loss, could yield one-petaflop systems that use just 25 kW and 100 petaflop systems that operate at 200 kW, including the cryogenic cooler. Compare this to the current greenest system, the L-CSC supercomputer from the GSI Helmholtz Center, which achieved 5.27 gigaflops-per-watt on the most-recent Green500 list. If scaled linearly to an exaflop supercomputing system, it would consume about 190 megawatts (MW), still quite a bit short of DARPA targets, which range from 20MW to 67MW.IARPA C3 program performance projections

The C3 project, which recently awarded an unspecified amount of funding to vendors IBM, Raytheon-BBN and Northrop Grumman Corporation, will focus on developing and integrating superconducting logic with new kinds of cryogenic memory as the basis for a small-scale working model of a superconducting computer. Superconducting circuit fabrication will be provided by MIT Lincoln Laboratory and independent test and evaluation will be carried out by NIST, Boulder.

Funding high-risk/high-payoff research in support of national intelligence is IARPA’s speciality, and superconducting computing is seen as a serious post-silicon contender for HPC, according to C3 Program Manager Dr. Marc Manheimer, who was interviewed for this piece. A long-time laboratory physicist with expertise in superconducting and in cryogenic magnetic phenomena, Dr. Manheimer provided additional details about the state of the technology and the scope of the program.

HPCwire: You’ve written about the promise of superconducting and cryogenic technologies to address the space and energy challenges of traditional silicon-based supercomputing. How tractable a problem is superconducting supercomputing?

Dr. Manheimer: IARPA only takes on the hardest problems, so it’s a serious technical challenge, but we think we have a path forward to solve all of the challenges associated with superconducting supercomputing. In particular, the challenge that I see as the hardest is to develop high-density, high-efficiency, low-latency, cryogenic memory.

HPCwire: More so than the logic?

Dr. Manheimer: The logic has been around in primitive forms for about 25-30 years, and a number of primitive circuits have been fabricated and tested, so we think we can move forward with the logic in a pretty straight-forward manner. We’ve developed a fabrication facility at the Lincoln Laboratory, and we’re upgrading that so that fab can produce circuits at the level that we need to prove out this technology. On the other hand, these cryogenic memory ideas – the other half of the program – are very new, and are for the most part untested, and we will have to go through developing the basic memory cells and put them into an array and drive them and control them in a pretty short time frame as compared with typical technology development.

HPCwire: The release put out by IARPA mentions the program would be carried out in two stages: components development for the memory and logic subsystems, then integration. Is the roadmap still following the three year plus two year split outlined last year?

Dr. Manheimer: Yes, for the first three years, the logic people have to produce some key demonstration circuits and the memory people have to produce a small-scale but complete memory, including decoders and drivers, and we also need the performers to develop a plan for how they are going to integrate these. That’s the first stage. Then we’ll have another call for proposals for the second stage.

HPCwire: So the three vendors that were awarded funding, are these first-phase partners?

Dr. Manheimer: These are independent projects. Northrup Grumman has two projects that they’ve succeeded in getting funding for. One is a logic program and one is a memory program. The Raytheon Corporation is running a memory program, and the IBM Corporation is running a logic program. So there are two logic projects and two memory projects.

HPCwire: The release also mentioned standard benchmarking programs…can you tell me more about these?

Dr. Manheimer: We’re developing a prototype, a small-scale computer, and we’re going to have to figure out what applications it’s suitable for as we scale it up. We’re going to be talking to a variety of customers with a variety of application types and we’re going to have our customers develop programs that they think will be useful in telling them what the potential of superconducting supercomputing computing is to their applications.

HPCwire: How different of an ecosystem is this compared to traditional silicon-based CMOS?

Dr. Manheimer: What we’re planning to do is reuse programs so we can use standard software, but one of the things that is missing from our ecosystem that is readily available in the semiconducting system is the development software suite. Right now if you want to develop a superconducting logic circuit of any scale, you pretty much have to do it on your own. There is no Mentor Graphics program, for example, available for superconducting computing.

HPCwire: Is IARPA thinking about specific applications yet and is this a general purpose system?

Dr. Manheimer: For now, we’re thinking general-purpose computing and we’ll see what develops in the next few years.

HPCwire: Do you think superconducting logic will be the main successor to silicon-based CMOS or is it more likely that we will have multiple computing device-level technologies that will evolve to fill this gap?

Dr. Manheimer: For high-performance computing, I think superconducting supercomputing has a high probability of being the winner. For smaller scale applications, I think CMOS will be perfectly fine for providing general-purpose computing for almost everyone. Clearly, superconducting computing won’t be useful for any portable format. Everyone will be carrying around his or her own cryogenic cooler…no, that’s not going to happen, so CMOS will be around for a long time.

HPCwire: Speaking of cryo-coolers, how much space do they take up?

Dr. Manheimer: Not much, I did a comparison between Titan at Oak Ridge and a projection of our superconducting technology, and we think that including the cryo-cooler, our supercomputer will take up about one-twentieth of the floor space, and that doesn’t include Titan’s cooling system.

HPCwire: Moving over to performance, what kind of performance goals have you set for the project and in what kind of timeframe? Is it possible to get to exascale and beyond with this technology?

Dr. Manheimer: We’ve only set goals for the C3 program, and we hope to be able to judge from the C3 program results how scalable the technology is. But we have very specific energy goals in mind for C3 and throughput goals, which are hosted on the website [and depicted below]. There are two things that we have to learn from C3. The first is whether you can actually build a supercomputer based on this technology if you really wanted to, and second do you really want to? Is it going to be prohibitively expensive and is the amount of technology required going to be too high with just no clear path forward? So those are questions that we have to seriously address at the end of C3.

IARPA C3 program diagram

HPCwire: Any estimate as to how much it will cost to build the world’s first superconducting supercomputer?

Dr. Manheimer: Not really, but if you look at conventional CMOS computers, these big supercomputers take several hundred million dollars.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

SC21: Larry Smarr on The Rise of Supernetwork Data Intensive Computing

November 26, 2021

Larry Smarr, founding director of Calit2 (now Distinguished Professor Emeritus at the University of California San Diego) and the first director of NCSA, is one of the seminal figures in the U.S. supercomputing community. What began as a personal drive, shared by others, to spur the creation of supercomputers in the U.S. for scientific use, later expanded into a... Read more…

Three Chinese Exascale Systems Detailed at SC21: Two Operational and One Delayed

November 24, 2021

Details about two previously rumored Chinese exascale systems came to light during last week’s SC21 proceedings. Asked about these systems during the Top500 media briefing on Monday, Nov. 15, list author and co-founder Jack Dongarra indicated he was aware of some very impressive results, but withheld comment when asked directly if he had... Read more…

SC21’s Student Cluster Competition Winners Announced

November 19, 2021

SC21 may have been the first major supercomputing conference to return to in-person activities, but not everything returned to the live menu: the Student Cluster Competition – held virtually at ISC 2020, SC20 and ISC 2021 – was again held virtually at SC21. Nevertheless, Students@SC Chair Jay Lofstead took the physical stage at SC21 on Thursday to announce the... Read more…

MLPerf Issues HPC 1.0 Benchmark Results Featuring Impressive Systems (Think Fugaku)

November 19, 2021

Earlier this week MLCommons issued results from its latest MLPerf HPC training benchmarking exercise. Unlike other MLPerf benchmarks, which mostly measure the training and inference performance of systems that are availa Read more…

Gordon Bell Special Prize Goes to World-Shaping COVID Droplet Work

November 18, 2021

For the second (and, hopefully, final) year in a row, SC21 included a second major research award alongside the ACM 2021 Gordon Bell Prize: the Gordon Bell Special Prize for High Performance Computing-Based COVID-19 Research. Last year, the first iteration of this award went to simulations of the SARS-CoV-2 spike protein; this year, the prize went... Read more…

AWS Solution Channel

Royalty-free stock illustration ID: 1616974732

Using the Slurm REST API to integrate with distributed architectures on AWS

The Slurm Workload Manager by SchedMD is a popular HPC scheduler and is supported by AWS ParallelCluster, an elastic HPC cluster management service offered by AWS. Read more…

2021 Gordon Bell Prize Goes to Exascale-Powered Quantum Supremacy Challenge

November 18, 2021

Today at the hybrid virtual/in-person SC21 conference, the organizers announced the winners of the 2021 ACM Gordon Bell Prize: a team of Chinese researchers leveraging the new exascale Sunway system to simulate quantum circuits. The Gordon Bell Prize, which comes with an award of $10,000 courtesy of HPC pioneer Gordon Bell, is awarded annually... Read more…

SC21: Larry Smarr on The Rise of Supernetwork Data Intensive Computing

November 26, 2021

Larry Smarr, founding director of Calit2 (now Distinguished Professor Emeritus at the University of California San Diego) and the first director of NCSA, is one of the seminal figures in the U.S. supercomputing community. What began as a personal drive, shared by others, to spur the creation of supercomputers in the U.S. for scientific use, later expanded into a... Read more…

Three Chinese Exascale Systems Detailed at SC21: Two Operational and One Delayed

November 24, 2021

Details about two previously rumored Chinese exascale systems came to light during last week’s SC21 proceedings. Asked about these systems during the Top500 media briefing on Monday, Nov. 15, list author and co-founder Jack Dongarra indicated he was aware of some very impressive results, but withheld comment when asked directly if he had... Read more…

SC21’s Student Cluster Competition Winners Announced

November 19, 2021

SC21 may have been the first major supercomputing conference to return to in-person activities, but not everything returned to the live menu: the Student Cluster Competition – held virtually at ISC 2020, SC20 and ISC 2021 – was again held virtually at SC21. Nevertheless, Students@SC Chair Jay Lofstead took the physical stage at SC21 on Thursday to announce the... Read more…

MLPerf Issues HPC 1.0 Benchmark Results Featuring Impressive Systems (Think Fugaku)

November 19, 2021

Earlier this week MLCommons issued results from its latest MLPerf HPC training benchmarking exercise. Unlike other MLPerf benchmarks, which mostly measure the t Read more…

Gordon Bell Special Prize Goes to World-Shaping COVID Droplet Work

November 18, 2021

For the second (and, hopefully, final) year in a row, SC21 included a second major research award alongside the ACM 2021 Gordon Bell Prize: the Gordon Bell Special Prize for High Performance Computing-Based COVID-19 Research. Last year, the first iteration of this award went to simulations of the SARS-CoV-2 spike protein; this year, the prize went... Read more…

2021 Gordon Bell Prize Goes to Exascale-Powered Quantum Supremacy Challenge

November 18, 2021

Today at the hybrid virtual/in-person SC21 conference, the organizers announced the winners of the 2021 ACM Gordon Bell Prize: a team of Chinese researchers leveraging the new exascale Sunway system to simulate quantum circuits. The Gordon Bell Prize, which comes with an award of $10,000 courtesy of HPC pioneer Gordon Bell, is awarded annually... Read more…

SC21 Keynote: Internet Pioneer Vint Cerf on Shakespeare, Chatbots, and Being Human

November 17, 2021

Unlike the deep technical dives of many SC keynotes, Internet pioneer Vint Cerf steered clear of the trenches and took leisurely stroll through a range of human-machine interactions, touching on ML’s growing capabilities while noting potholes to be avoided if possible. Cerf, of course, is co-designer with Bob Kahn of the TCP/IP protocols and architecture of the internet. He’s heralded... Read more…

France’s Jean Zay Supercomputer Boosts AI, HPC Research with Influx of A100 80GB GPUs

November 17, 2021

Since coming online in the fall of 2019 in Paris, the Jean Zay supercomputer has been one of Europe’s most powerful supercomputers available to HPC and AI researchers. And now, through the addition of new Nvidia A100 80GB GPUs and other hardware, the Jean Zay will soon offer double the compute capacity it offers for AI and HPC research, according to GENCI... Read more…

IonQ Is First Quantum Startup to Go Public; Will It be First to Deliver Profits?

November 3, 2021

On October 1 of this year, IonQ became the first pure-play quantum computing start-up to go public. At this writing, the stock (NYSE: IONQ) was around $15 and its market capitalization was roughly $2.89 billion. Co-founder and chief scientist Chris Monroe says it was fun to have a few of the company’s roughly 100 employees travel to New York to ring the opening bell of the New York Stock... Read more…

Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip

August 20, 2021

Two months ago, Tesla revealed a massive GPU cluster that it said was “roughly the number five supercomputer in the world,” and which was just a precursor to Tesla’s real supercomputing moonshot: the long-rumored, little-detailed Dojo system. Read more…

Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip

August 27, 2021

Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim... Read more…

US Closes in on Exascale: Frontier Installation Is Underway

September 29, 2021

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, held by Zoom this week (Sept. 29-30), it was revealed that the Frontier supercomputer is currently being installed at Oak Ridge National Laboratory in Oak Ridge, Tenn. The staff at the Oak Ridge Leadership... Read more…

AMD Launches Milan-X CPU with 3D V-Cache and Multichip Instinct MI200 GPU

November 8, 2021

At a virtual event this morning, AMD CEO Lisa Su unveiled the company’s latest and much-anticipated server products: the new Milan-X CPU, which leverages AMD’s new 3D V-Cache technology; and its new Instinct MI200 GPU, which provides up to 220 compute units across two Infinity Fabric-connected dies, delivering an astounding 47.9 peak double-precision teraflops. “We're in a high-performance computing megacycle, driven by the growing need to deploy additional compute performance... Read more…

Intel Reorgs HPC Group, Creates Two ‘Super Compute’ Groups

October 15, 2021

Following on changes made in June that moved Intel’s HPC unit out of the Data Platform Group and into the newly created Accelerated Computing Systems and Graphics (AXG) business unit, led by Raja Koduri, Intel is making further updates to the HPC group and announcing... Read more…

Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future

August 10, 2021

Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel’s C/C++ compiler is complete. The transition is part of In Read more…

Killer Instinct: AMD’s Multi-Chip MI200 GPU Readies for a Major Global Debut

October 21, 2021

AMD’s next-generation supercomputer GPU is on its way – and by all appearances, it’s about to make a name for itself. The AMD Radeon Instinct MI200 GPU (a successor to the MI100) will, over the next year, begin to power three massive systems on three continents: the United States’ exascale Frontier system; the European Union’s pre-exascale LUMI system; and Australia’s petascale Setonix system. Read more…

Leading Solution Providers

Contributors

Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel

August 25, 2021

The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more…

D-Wave Embraces Gate-Based Quantum Computing; Charts Path Forward

October 21, 2021

Earlier this month D-Wave Systems, the quantum computing pioneer that has long championed quantum annealing-based quantum computing (and sometimes taken heat fo Read more…

Ahead of ‘Dojo,’ Tesla Reveals Its Massive Precursor Supercomputer

June 22, 2021

In spring 2019, Tesla made cryptic reference to a project called Dojo, a “super-powerful training computer” for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: “Tesla is developing a [neural network] training computer... Read more…

HPE Wins $2B GreenLake HPC-as-a-Service Deal with NSA

September 1, 2021

In the heated, oft-contentious, government IT space, HPE has won a massive $2 billion contract to provide HPC and AI services to the United States’ National Security Agency (NSA). Following on the heels of the now-canceled $10 billion JEDI contract (reissued as JWCC) and a $10 billion... Read more…

The Latest MLPerf Inference Results: Nvidia GPUs Hold Sway but Here Come CPUs and Intel

September 22, 2021

The latest round of MLPerf inference benchmark (v 1.1) results was released today and Nvidia again dominated, sweeping the top spots in the closed (apples-to-ap Read more…

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

Quantum Computer Market Headed to $830M in 2024

September 13, 2021

What is one to make of the quantum computing market? Energized (lots of funding) but still chaotic and advancing in unpredictable ways (e.g. competing qubit tec Read more…

Julia Update: Adoption Keeps Climbing; Is It a Python Challenger?

January 13, 2021

The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire