Planning for Post Moore’s Law

By Tiffany Trader

May 28, 2014

In this video from Hot Chips 25, Dr. Robert Colwell of DARPA delivers an insightful overview on the “looming issue” that is the death of Moore’s law. Colwell starts out with the humorous point that “physics doesn’t care what we believe.” Believing that Moore’s law – Gordon Moore’s 1965 observation that a chip’s transistor count doubles every 18-24 months – will last indefinitely, does not make it so.

According to Colwell, the exponential advances that have undergirded the microprocessor industry for the past five decades will start to break down over the next decade. More specifically, he expects it will come to an end between 2020-2022 at the 5-7 nanometer node. The safest thing to do, in Colwell’s opinion, is to keep pushing the envelope on miniaturization, but at the same time plan for the future.

The DARPA rep starts with three givens:

1. All exponentials must end (or they will “eat the universe”)
2. Electronics existed before Moore’s law
3. There will be electronics after it

Getting specific with the mission at hand, Colwell lays out the “canonical Moore’s law chip designer’s algorithm” as follows:

Given constraints
{Si area, schedule, team, tools, power}
How can I best design a chip to
sell huge unit volumes
at high yields
and high profits?

Colwell is doubtful that there will be a replacement that can compete with Moore’s law, which he deems the “best tech exponential improvement trend ever.” Silicon improvements have essentially been free to designers. From 1980 to 2010, clocks are 3,500x faster while architecture achieved perhaps a 50X improvement. “The silicon gave us way more than the architects could have made up for,” Colwell contends.

“So what happens when the energizer-bunny silicon engine runs out and we have to resort to being clever?” he asks. “How much runway is left? I’m saying we’re going to do the best we can, but don’t expect 3,500X.”

As for the argument that computer designers will continue to find other ways to make chips faster as long as there is a demand, Colwell contends that that will be true initially, but incremental tweaks cannot make up for the loss of an exponential.

Even though the DARPA rep is skeptical about a post-Moore’s law replacement, he points to several potential paths, some more promising than others:

  • 3D stacking and improved packaging.
  • Better cooling, longer battery life.
  • Software, microarchitecture, architecture, I/O, memory (plenty of room for I/O and memory since still a first order impact on performance).
  • Write new apps.
  • Resilience (can be a difficult sell in general enterprise).
  • Alternative switch technologies.
  • DARPA perfect and upside, beyond convention.
  • Better system interfaces (sensors, wireless, displays, human interface, etc.).
  • Marketing.

While the end of free can be a scary thing, some of the biggest breakthroughs are the result of unyielding constraints. Look, for example, at the mobile computing industry, which has faced severe power and compute constraints. Now there is an entire ecosystem (i.e., ARM) built up around using “mobile” chips in servers.

If you haven’t watched this interesting and fast-paced keynote yet, check it out below:

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Nvidia Debuts Turing Architecture, Focusing on Real-Time Ray Tracing

August 16, 2018

From the SIGGRAPH professional graphics conference in Vancouver this week, Nvidia CEO Jensen Huang unveiled Turing, the company's next-gen GPU platform that introduces new RT Cores to accelerate ray tracing and new Tenso Read more…

By Tiffany Trader

HPC Coding: The Power of L(o)osing Control

August 16, 2018

Exascale roadmaps, exascale projects and exascale lobbyists ask, on-again-off-again, for a fundamental rewrite of major code building blocks. Otherwise, so they claim, codes will not scale up. Naturally, some exascale pr Read more…

By Tobias Weinzierl

STAQ(ing) the Quantum Computing Deck

August 16, 2018

Quantum computers – at least for now – remain noisy. That’s another way of saying unreliable and in diverse ways that often depend on the specific quantum technology used. One idea is to mitigate noisiness and perh Read more…

By John Russell

HPE Extreme Performance Solutions

Introducing the First Integrated System Management Software for HPC Clusters from HPE

How do you manage your complex, growing cluster environments? Answer that big challenge with the new HPC cluster management solution: HPE Performance Cluster Manager. Read more…

IBM Accelerated Insights

Super Problem Solving

You might think that tackling the world’s toughest problems is a job only for superheroes, but at special places such as the Oak Ridge National Laboratory, supercomputers are the real heroes. Read more…

NREL ‘Eagle’ Supercomputer to Advance Energy Tech R&D

August 14, 2018

The U.S. Department of Energy (DOE) National Renewable Energy Laboratory (NREL) has contracted with Hewlett Packard Enterprise (HPE) for a new 8-petaflops (peak) supercomputer that will be used to advance early-stage R&a Read more…

By Tiffany Trader

STAQ(ing) the Quantum Computing Deck

August 16, 2018

Quantum computers – at least for now – remain noisy. That’s another way of saying unreliable and in diverse ways that often depend on the specific quantum Read more…

By John Russell

NREL ‘Eagle’ Supercomputer to Advance Energy Tech R&D

August 14, 2018

The U.S. Department of Energy (DOE) National Renewable Energy Laboratory (NREL) has contracted with Hewlett Packard Enterprise (HPE) for a new 8-petaflops (peak Read more…

By Tiffany Trader

CERN Project Sees Orders-of-Magnitude Speedup with AI Approach

August 14, 2018

An award-winning effort at CERN has demonstrated potential to significantly change how the physics based modeling and simulation communities view machine learni Read more…

By Rob Farber

Intel Announces Cooper Lake, Advances AI Strategy

August 9, 2018

Intel's chief datacenter exec Navin Shenoy kicked off the company's Data-Centric Innovation Summit Wednesday, the day-long program devoted to Intel's datacenter Read more…

By Tiffany Trader

SLATE Update: Making Math Libraries Exascale-ready

August 9, 2018

Practically-speaking, achieving exascale computing requires enabling HPC software to effectively use accelerators – mostly GPUs at present – and that remain Read more…

By John Russell

Summertime in Washington: Some Unexpected Advanced Computing News

August 8, 2018

Summertime in Washington DC is known for its heat and humidity. That is why most people get away to either the mountains or the seashore and things slow down. H Read more…

By Alex R. Larzelere

NSF Invests $15 Million in Quantum STAQ

August 7, 2018

Quantum computing development is in full ascent as global backers aim to transcend the limitations of classical computing by leveraging the magical-seeming prop Read more…

By Tiffany Trader

By the Numbers: Cray Would Like Exascale to Be the Icing on the Cake

August 1, 2018

On its earnings call held for investors yesterday, Cray gave an accounting for its latest quarterly financials, offered future guidance and provided an update o Read more…

By Tiffany Trader

Leading Solution Providers

SC17 Booth Video Tours Playlist

Altair @ SC17

Altair

AMD @ SC17

AMD

ASRock Rack @ SC17

ASRock Rack

CEJN @ SC17

CEJN

DDN Storage @ SC17

DDN Storage

Huawei @ SC17

Huawei

IBM @ SC17

IBM

IBM Power Systems @ SC17

IBM Power Systems

Intel @ SC17

Intel

Lenovo @ SC17

Lenovo

Mellanox Technologies @ SC17

Mellanox Technologies

Microsoft @ SC17

Microsoft

Penguin Computing @ SC17

Penguin Computing

Pure Storage @ SC17

Pure Storage

Supericro @ SC17

Supericro

Tyan @ SC17

Tyan

Univa @ SC17

Univa

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This