Esperanto Unveils ML Chip with Nearly 1,100 RISC-V Cores

By Oliver Peckham

December 8, 2020

At the RISC-V Summit today, Art Swift, CEO of Esperanto Technologies, announced a new, RISC-V based chip aimed at machine learning and containing nearly 1,100 low-power cores based on the open-source RISC-V architecture. 

Esperanto Technologies, headquartered in Mountain View, Calif., with other sites across the U.S. and Europe, was created in 2014 “with the goal of making RISC-V the architecture of choice for compute-intensive applications such as AI and machine learning.” Swift traced the history of the new chip back to 2017, when Dave Ditzel – the founder and chairman of Esperanto – laid out the vision for Esperanto at the seventh RISC-V workshop. 

At that workshop, Ditzel set a goal of “laying down 4,000 or more cores on a single device.” Ditzel called for both a simple instruction set through RISC-V and innovation in the realms of custom microarchitectures and proprietary low-power design techniques. “In the three ensuing years, we’ve raised $77 million dollars of venture capital and now are at the point of having completed our first design – the first of a family of AI processors based on RISC-V,” Swift said.

The Esperanto ET-SoC-1 die plot. Image courtesy of Art Swift.

The new chip, called ET-SoC-1, contains two varieties of general-purpose 64-bit RISC-V cores: first, the ET-Maxion, a superscalar out-of-order core (4 per chip); second, the ET-Minion, a “leaner, energy-efficient” in-order multithreaded core containing a large coprocessor for machine learning applications (1,089 per chip, including one service processor). 

The chip’s 23.8 billion transistors, spread across 7nm technology from TSMC, are aimed squarely at hyperscale data applications (“particularly inferencing,” Swift said).  Swift said that the chip uses a general-purpose architecture to shield the customer from incompatibilities that might be introduced by the evolution of ML models over time.

As Swift explained it, in datacenter applications, the ET-Maxion cores are likely to be overruled by accompanying Intel or AMD host CPUs – but in edge applications, the Maxions become much more important for keeping costs low. 

A Glacier Point v2 card with room for up to six ET-SoC-1 chips. Image courtesy of Art Swift.

The chips support PCIe 4.0 and DDR4x RAM (up to 32GB), and Swift says they can fit up to six of their chips on a single PCIe card. By way of example, Swift showed off an open-source Glacier Point card with room for six ET-SoC-1 chips. (“This is the whole strategy we have, to leverage as much as possible the open-source community.”)

Along those lines, software-wise, “we support all the common machine learning frameworks,” Swift said, explaining that Esperanto leveraged Facebook’s open-source GLOW compiler as a hub.

While they haven’t yet worked with the physical silicon, Swift shared data based on emulation of the chip. “When we measure our performance versus the actual measured performance of the incumbent solutions in the datacenter,” he said, “we find that we expect to deliver 50 times better performance on key workloads like recommendation networks and up to 30 times better than the incumbents for image classification.” 

“But probably more exciting and more important,” he continued, “is the energy efficiency which we’re able to derive. We expect to see 100 times better energy efficiency in terms of inferences per watt than the incumbent solutions.”

Esperanto attributes ET-SoC-1’s performance efficiency to several factors, including RISC-V’s simplicity, the machine learning coprocessors on the ET-Minion cores, a “uniquely optimized” memory hierarchy and custom low-voltage circuits. 

Swift repeatedly stressed that ET-SoC-1 is just the first member of Esperanto’s new product lineup, explaining that the chip’s tile-based design made it easy “scale up to more thousands of cores or scale down to hundreds of cores,” serving needs “from hyperscale datacenters to edge AI and everything in-between.”

Esperanto’s announcement comes on the heels of Nvidia’s deal to acquire Arm, which left many wondering if RISC-V would see a post-acquisition surge in interest and adoption. Esperanto is also entering an increasingly crowded market for inference chips, with competition from the likes of Xilinx, Mythic, Groq and Intel’s Habana Labs.

Header image: a cutout from a diagram of ET-SoC-1’s many, many RISC-V cores. Image courtesy of Art Swift.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Boffo HPC Conference Sessions: Leicester 2024

November 11, 2024

Leicester was the center of the HPC universe on October 15-16 as the HPC/AI Advisory Council and DiRAC hosted their sixth annual UK conference.The theme this year was “Democratising HPC and AI Opportunities” was co Read more…

Top500 Wild Cards Could Add Thrills to Supercomputing 2024 Show

November 11, 2024

The fantastic Supercomputing 2024 show is coming back to Atlanta this year. If last year was any indication, there will be plenty of coffee flowing and lots of discussions around power efficiency, storage, and the future Read more…

The Growing E-Waste Footprint of GenAI

November 7, 2024

The rapid advancement of digital technologies has led to the proliferation of electronic devices and systems, resulting in an alarming increase in electronic waste (e-waste).  GenAI, in particular, requires substantial Read more…

OSI Open AI Definition Stops Short of Requiring Open Data for LLMs

November 6, 2024

The movement toward open source AI made progress today when the Open Source Initiative released the first Open Source AI Definition (OSAID). While the OSAID provides one step forward, the lack of requirements around open Read more…

D-Wave Readies 4,400-plus-qubit Advantage2 System for Use

November 6, 2024

Quantum computing pioneer D-Wave today announced it had completed calibration and benchmarking the latest latest version of its Advantage2 quantum processor, a 4,400-plus-qubit device. D-Wave said that compared with the Read more…

Microsoft Azure & AMD Solution Channel

Join Microsoft Azure and AMD at SC24

Atlanta, Georgia is the place to be this fall as the high-performance computing (HPC) community convenes for Supercomputing 2024. SC24 will bring together an unparalleled mix of scientists, engineers, researchers, educators, programmers, and developers for a week of learning and sharing. Read more…

Bill Gropp on ‘Different Approaches to AI’

November 6, 2024

Around this same time last year, I expounded on what the “Future of AI” may entail. A lot has happened in the 12 months since then, including new approaches, new trends and, yes, new complications. A lot of the ne Read more…

Top500 Wild Cards Could Add Thrills to Supercomputing 2024 Show

November 11, 2024

The fantastic Supercomputing 2024 show is coming back to Atlanta this year. If last year was any indication, there will be plenty of coffee flowing and lots of Read more…

OSI Open AI Definition Stops Short of Requiring Open Data for LLMs

November 6, 2024

The movement toward open source AI made progress today when the Open Source Initiative released the first Open Source AI Definition (OSAID). While the OSAID pro Read more…

Bill Gropp on ‘Different Approaches to AI’

November 6, 2024

Around this same time last year, I expounded on what the “Future of AI” may entail. A lot has happened in the 12 months since then, including new approaches Read more…

Shutterstock 1179408610

Google Cloud Sporting a New Look in HPC and AI Hardware

November 5, 2024

It's raining hardware at Google Cloud, with the company making major upgrades in advance of bringing Nvidia's Blackwell GPUs into its fold next year. The upg Read more…

Go (Mountain) West, Quantum Workers! CU, CUbit, and Elevate Quantum Issue Workforce Roadmap

November 5, 2024

Last week the University of Colorado (Boulder), the CUbit Quantum Initiative, and the Elevate Quantum consortium released workforce roadmap for educating and bu Read more…

Collaboration Speeds Complex Chemical Modeling

November 4, 2024

A recent collaboration among researchers from HUN-REN Wigner Research Centre for Physics in Hungary and the Department of Energy's Pacific Northwest National La Read more…

High-Performance Storage for AI and Analytics Panel

October 31, 2024

When storage is mentioned in an AI or Big Data analytics context, it is assumed to be a high-performance system. In practice, it may not be, and the user eventu Read more…

Shutterstock_556401859

Role Reversal: Google Teases Nvidia’s Blackwell as It Softens TPU Rivalry

October 30, 2024

Customers now have access to Google's homegrown hardware -- its Axion CPU and latest Trillium TPU -- in its Cloud service.  At the same time, Google gave custo Read more…

Sorry, but nothing matches what you're looking for. Please try again with some different keywords.

Leading Solution Providers

Contributors

CORNELL I-WAY DEMONSTRATION PITS PARASITE AGAINST VICTIM

October 6, 1995

Ithaca, NY --Visitors to this year's Supercomputing '95 (SC'95) conference will witness a life-and-death struggle between parasite and victim, using virtual Read more…

SGI POWERS VIRTUAL OPERATING ROOM USED IN SURGEON TRAINING

October 6, 1995

Surgery simulations to date have largely been created through the development of dedicated applications requiring considerable programming and computer graphi Read more…

U.S. Will Relax Export Restrictions on Supercomputers

October 6, 1995

New York, NY -- U.S. President Bill Clinton has announced that he will definitely relax restrictions on exports of high-performance computers, giving a boost Read more…

Dutch HPC Center Will Have 20 GFlop, 76-Node SP2 Online by 1996

October 6, 1995

Amsterdam, the Netherlands -- SARA, (Stichting Academisch Rekencentrum Amsterdam), Academic Computing Services of Amsterdam recently announced that it has pur Read more…

Cray Delivers J916 Compact Supercomputer to Solvay Chemical

October 6, 1995

Eagan, Minn. -- Cray Research Inc. has delivered a Cray J916 low-cost compact supercomputer and Cray's UniChem client/server computational chemistry software Read more…

NEC Laboratory Reviews First Year of Cooperative Projects

October 6, 1995

Sankt Augustin, Germany -- NEC C&C (Computers and Communication) Research Laboratory at the GMD Technopark has wrapped up its first year of operation. Read more…

Sun and Sybase Say SQL Server 11 Benchmarks at 4544.60 tpmC

October 6, 1995

Mountain View, Calif. -- Sun Microsystems, Inc. and Sybase, Inc. recently announced the first benchmark results for SQL Server 11. The result represents a n Read more…

New Study Says Parallel Processing Market Will Reach $14B in 1999

October 6, 1995

Mountain View, Calif. -- A study by the Palo Alto Management Group (PAMG) indicates the market for parallel processing systems will increase at more than 4 Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire