Adapteva Builds Manycore Processor That Will Deliver 70 Gigaflops/Watt

By Michael Feldman

October 3, 2011

In May, chip startup Adapteva debuted Epiphany, a manycore architecture designed to maximize floating point horsepower with the lowest possible energy footprint. The initial silicon was a 16-core processor, implemented on the 65nm process node. This week, the company announced it has taped out a 64-core version of the design on the 28nm process node, delivering 100 gigaflops of performance at under 2 watts of power. 
 
The three-year old company is targeting the two extremes of the computing spectrum with their Epiphany architecture: supercomputing and mobile devices. The common denomination in both cases is an obsession to minimize power consumption, something the Adapteva designers have done extremely well.

According to Adapteva founder and CEO Andreas Olofsson, this latest silicon, officially known as Epiphany-IV (it’s the fourth generation of the architecture) runs at 800 MHz and is expected to achieve 70 single precision gigaflops/watt, twice the efficiency of their previous design. Their fab partner, GLOBALFOUNDRIES, is expected to start churning out samples of the 64-core wonder in January 2012.

As we reported in May, the RISC-based Epiphany design employs a 2D, low overhead, low latency mesh for inter-core communication, with each core containing 32KB of local memory for explicit cache control (in order to maximize data movement efficiency). Although the latest design implements 64 cores, Adapteva is projecting processors with as many as 4,096 cores per chip, delivering upwards of 4 teraflops.

While the company can’t claim a design win in either the HPC or mobile world, embedded device maker BittWare has picked up the Adapteva chip for one of its FPGA Mezzanine Cards (FMCs). That product pairs four Epiphany 16-core processors with an Altera Stratix FPGA. The sub-10 watt card delivers 128 gigaflops and is aimed at applications such as digital signal processing, defense, and communications. Although Olofsson is thrilled to get BittWare’s business, he thinks their are much larger opportunities to be had if he can find some other enterprising partners.

For example, he believes the new 64-core version, officially known as would be ideal for a tablet PC, smartphone, or an HPC board. In the latter case, Olofsson envisions an array of Epiphany chips on a board that can be plugged into an HPC server node (or a whole cluster), to offload floating-point intensive workloads. The chip array would be hooked together as an extension of the on-chip communication fabric that connects the individual cores. “You could easily fit a couple of teraflops on a board at a very reasonable power consumption,” Olofsson told HPCwire.

The CEO says his five-man company is profitable now, but they need a deep-pocketed partner or two to take to technology to the next level. In particular, Epiphany would benefit greatly from a more complete software stack — compilers, debuggers, libraries and so on — to attract developers. The current Epiphany SDK, which provides an ANSI C development environment, is fine for the development kits Adapteva is handing out, but they’ll eventually need a production toolset if they hope to become a major manycore vendor.

The competition is already rather formidable. Intel, with its Many Integrated Core (MIC) x86 processor for high performance computing, has vast resources to develop and support that architecture. MIC will inherit Intel’s parallel software portfolio, making it automatically attractive to an established audience of developers. Although not set to debut until late 2012 or early 2013, Intel’s manycore offering already has a chalked up a major win in TACC’s “Stampede” supercomputer.

The other established manycore vendor, Tilera, already has 64-core chips in the field. In this case though, the architecture is more oriented toward general-purpose processing, rather than a floating point acceleration, so is mainly being targeted to cloud computing, networking, and multimedia applications.

Although the new breed of GPGPUs from NVIDIA and AMD are also being used as floating point accelerators, Olofsson doesn’t equate those designs with Epiphany, which relies on a more conventional CPU-type of architecture. And while he thinks both CUDA and OpenCL are worthwhile execution models for parallel programming, Olofsson believes the data-parallel-centric GPU design has too many restrictions. “GPUs are the answer for graphics,” he says. “I dont think they are the answer for HPC.”
 
Adapteva, with its laser focus on floating point performance and with no allegiance to either the x86 instruction set or graphics support, is able to squeeze a lot more performance per watt out its design. For example, the 32-core MIC prototype, Knights Ferry, delivers 1200 gigaflops of peak single precision performance. Assuming a power draw of 200 watts (which is probably on the conservative side), that translates to a performance efficiency of 6 SP gigaflops/watt.

That’s a far cry from the 35 SP gigaflops/watt Adapteva has already demonstrated, and even if Intel doubles or quadruples its efficiency when it launches the production Knights Corner MIC, by that time Adapteva should already have its 70 gigaflops/watt chips in the field. Even the upcoming Kepler GPU from NVIDIA is expected to deliver only about 10 SP gigaflops/watt.

If Adapteva’s story of a proprietary floating point accelerator sounds like a remake of the ClearSpeed story, that’s not quite the case. Olofsson maintains they are only in the semiconductor design business, with has no aspirations to churn out production processors, boards, and systems, like ClearSpeed tried to do. According to him, the idea is to entice other chip and board makers to license the technology, the same way ARM Holdings does for its microprocessor IP.

Speaking of which: ARM processor and device vendors could be ideal companions for Adapteva, given ARM’s penetration into the mobile space. In fact, Olofsson admits there is a tier 1 semiconductor vendor who is evaluating the Epiphany technology right now, and it’s a fair bet that the company is already an ARM licensee. The idea would be to either integrated the Epiphany design on-chip next to ARM cores, or just pair Epiphany chips with ARM processors on a card.

Perhaps a more interesting scenario is for AMD to license Epiphany (or even acquire the company outright). Even though AMD  is using its GPGPU technology to target HPC and their mobile ambitions, Epiphany would give them a cutting-edge accelerator technology to go head-to-head with Intel’s MIC architecture. It would also enable AMD to develop some rather unique mobile processor silicon to pair with their low-power x86 CPU designs.

In the short-term, one of Olofsson’s dreams is to get someone to build an Epiphany-equipped computer that can run Linpack (presumably, with a double precision floating point implementation of Epiphany) to get a Green500 ranking. The current champ is an IBM Blue Gene/Q prototype machine, which is based on a PowerPC A2 SoC that delivers about 3.7 gigaflops/watt (which, by the way is about what ClearSpeed’s ASIC was delivering in 2008 before the company unraveled). With its 10-fold performance per watt advantage, Olofsson thinks an Epiphany-based system could easily capture the number one spot on the Green500 list.

Although Adapteva has taken a somewhat unconventional approach with its manycore chips, Olofsson says their design will scale much better than legacy CPU architectures, like the x86, and will be much more efficient at extracting floating point performance than generalized graphics processors. And even though he’s battling much larger and wealthier semiconductor vendors, Olofsson likes his chances. “Multicore and manycore is the future of computing,” he says, “and we feel like we’re right in the middle of it.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire