AI Cloud Competition Heats Up: Google’s TPUs, Amazon Building AI Chip

By Doug Black

February 12, 2018

Competition in the white hot AI (and public cloud) market pits Google against Amazon this week, with Google offering AI hardware on its cloud platform intended to make it easier, faster and cheaper to train and run machine learning/deep learning systems, while Amazon is reportedly developing its own AI chip portfolio. It’s the latest in a series of processor-related moves by the two companies, along with Microsoft Azure, IBM Cloud and other public cloud services providers, have made in recent months to position themselves as AI becomes increasingly integrated into our business and home lives.

Google is making Cloud TPU (Tensor Processing Units) accelerators available starting today on the Google Cloud Platform (GCP), an offering the company said will help get machine learning (ML) models trained and running more quickly.

Cloud TPUs is Google-designed hardware designed to speed and scale up ML workloads programmed with TensorFlow. Built with four custom ASICs, each Cloud TPU has up to 180 teraflops of floating-point performance and 64 GB of memory on a single board.

“Instead of waiting for a job to schedule on a shared compute cluster, you can have interactive, exclusive access to a network-attached Cloud TPU via a Google Compute Engine VM that you control and can customize,” said John Barrus, product manager for Cloud TPUs, Google Cloud, and Zak Stone, product manager for TensorFlow and Cloud TPUs, Google Brain Team, in a jointly written blog post. “Rather than waiting days or weeks to train a business-critical ML model, you can train several variants of the same model overnight on a fleet of Cloud TPUs and deploy the most accurate trained model in production the next day.”

Meanwhile, Reuters reports that Amazon two months ago paid $90 million for home security camera maker Blink and its energy efficient chip technology, according to unnamed sources.

“The deal’s rationale and price tag, previously unreported, underscore how Amazon aims to do more than sell another popular camera, as analysts had thought,” Reuters reported. “The online retailer is exploring chips exclusive to Blink that could lower production costs and lengthen the battery life of other gadgets, starting with Amazon’s Cloud Cam and potentially extending to its family of Echo speakers, one of the people said.”

According to the report, Amazon seeks to strengthen its ties to consumers via in-house devices. And while Amazon’s Cloud Cam and Echo need a plug-in power source, Blink claims its cameras can last two years on two AA lithium batteries.

Amazon declined to comment on the acquisition’s terms or strategy.

In addition, a published report from The Information states that Amazon is developing its own AI chip designed to work on the Echo and other hardware powered by Amazon’s Alexa virtual assistant. The chip reportedly will help its voice-enabled products handle tasks more efficiently by enabling processing to take place locally at the edge, by the device, rather than in AWS.

HPCwire reported last October that the surging demand for HPC and AI compute power has been shrinking the time gap between the introduction of high-end GPUs, primarily developed by Nvidia, and adoption by cloud vendors. “With the Nvidia V100 launch ink still drying and other big cloud vendors still working on Pascal generation rollouts, Amazon Web Services has become the first cloud giant to offer the Tesla Volta GPUs, beating out competitors Google and Microsoft,” HPCwire reported. “Google had been the first of the big three to offer P100 GPUs, but now we learn that Amazon is skipping Pascal entirely and going directly to Volta with the launch of V100-backed P3 instances that include up to eight GPUs connected by NVLink.”

As for Google’s Cloud TPUs, the company said it is simplifying ML training by providing high-level TensorFlow APIs, along with open-sourced reference Cloud TPU model implementations. Using a single Cloud TPU, the authors said ResNet-50 (and other popular models for image classification) “to the expected accuracy on the ImageNet benchmark challenge in less than a day” for less than $200.

Barrus and Stone also said customers will be able to use Cloud TPUs either alone or connected via “an ultra-fast, dedicated network to form multi-petaflop ML supercomputers that we call ‘TPU pods.'” Customers who start now with Cloud TPUs, they said, will benefit from time-to-accuracy improvements wne TPU pods are introduced later this year. “As we announced at NIPS 2017, both ResNet-50 and Transformer training times drop from the better part of a day to under 30 minutes on a full TPU pod, no code changes required.”

“We made a decision to focus our deep learning research on the cloud for many reasons,” said Alfred Spector, CTO at investment management firm Two Sigma, “but mostly to gain access to the latest machine learning infrastructure. Google Cloud TPUs are an example of innovative, rapidly evolving technology to support deep learning, and we found that moving TensorFlow workloads to TPUs has boosted our productivity by greatly reducing both the complexity of programming new models and the time required to train them. Using Cloud TPUs instead of clusters of other accelerators has allowed us to focus on building our models without being distracted by the need to manage the complexity of cluster communication patterns.”

On-demand transportation  company Lyft also said it’s impressed with the speed of Google Cloud TPUs. “What could normally take days can now take hours,” said Anantha Kancherla, head of software, self-driving Level 5, Lyft. “Deep learning is fast becoming the backbone of the software running self-driving cars. The results get better with more data, and there are major breakthroughs coming in algorithms every week. In this world, Cloud TPUs help us move quickly by incorporating the latest navigation-related data from our fleet of vehicles and the latest algorithmic advances from the research community.”

Barras and Stone highlighted in Cloud TPUs the usual advantages offered by public cloud computing.  “Instead of committing the capital, time and expertise required to design, install and maintain an on-site ML computing cluster with specialized power, cooling, networking and storage requirements,” they said, “you can benefit from large-scale, tightly-integrated ML infrastructure that has been heavily optimized at Google over many years.”

Google said Cloud TPUs are available in limited quantities today and usage is billed by the second at the rate of $6.50 USD / Cloud TPU / hour.

This article first appeared in our sister publication, EnterpriseTech.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

DARPA, NSF Seek Real-Time ML Processor

March 18, 2019

A new U.S. research initiative seeks to develop a processor capable of real-time learning while operating with the “efficiency of the human brain.” The National Science Foundation (NSF) and the Defense Advanced Re Read more…

By George Leopold

It’s Official: Aurora on Track to Be First U.S. Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaflops, will be delivered by the end of 2021 to Argonne Nation Read more…

By Tiffany Trader

NASA’s Pleiades Simulates Launch Abort Scenarios

March 15, 2019

NASA is using flow simulations running on its Pleiades supercomputer to help design the agency’s next manned spacecraft, Orion. Crew safety is paramount, so NASA engineers are using the HPC cluster to simulate and v Read more…

By George Leopold

HPE Extreme Performance Solutions

HPE and Intel® Omni-Path Architecture: How to Power a Cloud

Learn how HPE and Intel® Omni-Path Architecture provide critical infrastructure for leading Nordic HPC provider’s HPCFLOW cloud service.

powercloud_blog.jpgFor decades, HPE has been at the forefront of high-performance computing, and we’ve powered some of the fastest and most robust supercomputers in the world. Read more…

IBM Accelerated Insights

The Spark That Ignited A New World of Real-Time Analytics

High Performance Computing has always been about Big Data. It’s not uncommon for research datasets to contain millions of files and many terabytes, even petabytes of data, or more. Read more…

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

It’s Official: Aurora on Track to Be First U.S. Exascale Computer in 2021

March 18, 2019

The U.S. Department of Energy along with Intel and Cray confirmed today that an Intel/Cray supercomputer, "Aurora," capable of sustained performance of one exaf Read more…

By Tiffany Trader

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Oil and Gas Supercloud Clears Out Remaining Knights Landing Inventory: All 38,000 Wafers

March 13, 2019

The McCloud HPC service being built by Australia’s DownUnder GeoSolutions (DUG) outside Houston is set to become the largest oil and gas cloud in the world th Read more…

By Tiffany Trader

Quick Take: Trump’s 2020 Budget Spares DoE-funded HPC but Slams NSF and NIH

March 12, 2019

U.S. President Donald Trump’s 2020 budget request, released yesterday, proposes deep cuts in many science programs but seems to spare HPC funding by the Depar Read more…

By John Russell

Nvidia Wins Mellanox Stakes for $6.9 Billion

March 11, 2019

The long-rumored acquisition of Mellanox came to fruition this morning with GPU chipmaker Nvidia’s announcement that it has purchased the high-performance net Read more…

By Doug Black

Optalysys Rolls Commercial Optical Processor

March 7, 2019

Optalysys, Ltd., a U.K. company seeking to advance it optical co-processor technology, moved a step closer this week with the unveiling of what it claims is th Read more…

By George Leopold

Intel Responds to White House AI Initiative

March 6, 2019

The Trump Administration’s release last month of the “American AI Initiative,” aimed at prioritizing federal R&D investments in machine intelligence, Read more…

By Doug Black

IBM Pitches Quantum Volume as Benchmarking Tool for Gate-based Quantum Computers

March 6, 2019

IBM this week announced it had achieved its highest Quantum Volume number to date at the American Physical Society (APS) March meeting being held in Boston. Wha Read more…

By John Russell

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

The Case Against ‘The Case Against Quantum Computing’

January 9, 2019

It’s not easy to be a physicist. Richard Feynman (basically the Jimi Hendrix of physicists) once said: “The first principle is that you must not fool yourse Read more…

By Ben Criger

ClusterVision in Bankruptcy, Fate Uncertain

February 13, 2019

ClusterVision, European HPC specialists that have built and installed over 20 Top500-ranked systems in their nearly 17-year history, appear to be in the midst o Read more…

By Tiffany Trader

Intel Reportedly in $6B Bid for Mellanox

January 30, 2019

The latest rumors and reports around an acquisition of Mellanox focus on Intel, which has reportedly offered a $6 billion bid for the high performance interconn Read more…

By Doug Black

Looking for Light Reading? NSF-backed ‘Comic Books’ Tackle Quantum Computing

January 28, 2019

Still baffled by quantum computing? How about turning to comic books (graphic novels for the well-read among you) for some clarity and a little humor on QC. The Read more…

By John Russell

Why Nvidia Bought Mellanox: ‘Future Datacenters Will Be…Like High Performance Computers’

March 14, 2019

“Future datacenters of all kinds will be built like high performance computers,” said Nvidia CEO Jensen Huang during a phone briefing on Monday after Nvidia revealed scooping up the high performance networking company Mellanox for $6.9 billion. Read more…

By Tiffany Trader

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Deep500: ETH Researchers Introduce New Deep Learning Benchmark for HPC

February 5, 2019

ETH researchers have developed a new deep learning benchmarking environment – Deep500 – they say is “the first distributed and reproducible benchmarking s Read more…

By John Russell

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

IBM Quantum Update: Q System One Launch, New Collaborators, and QC Center Plans

January 10, 2019

IBM made three significant quantum computing announcements at CES this week. One was introduction of IBM Q System One; it’s really the integration of IBM’s Read more…

By John Russell

IBM Bets $2B Seeking 1000X AI Hardware Performance Boost

February 7, 2019

For now, AI systems are mostly machine learning-based and “narrow” – powerful as they are by today's standards, they're limited to performing a few, narro Read more…

By Doug Black

The Deep500 – Researchers Tackle an HPC Benchmark for Deep Learning

January 7, 2019

How do you know if an HPC system, particularly a larger-scale system, is well-suited for deep learning workloads? Today, that’s not an easy question to answer Read more…

By John Russell

HPC Reflections and (Mostly Hopeful) Predictions

December 19, 2018

So much ‘spaghetti’ gets tossed on walls by the technology community (vendors and researchers) to see what sticks that it is often difficult to peer through Read more…

By John Russell

Arm Unveils Neoverse N1 Platform with up to 128-Cores

February 20, 2019

Following on its Neoverse roadmap announcement last October, Arm today revealed its next-gen Neoverse microarchitecture with compute and throughput-optimized si Read more…

By Tiffany Trader

Move Over Lustre & Spectrum Scale – Here Comes BeeGFS?

November 26, 2018

Is BeeGFS – the parallel file system with European roots – on a path to compete with Lustre and Spectrum Scale worldwide in HPC environments? Frank Herold Read more…

By John Russell

France to Deploy AI-Focused Supercomputer: Jean Zay

January 22, 2019

HPE announced today that it won the contract to build a supercomputer that will drive France’s AI and HPC efforts. The computer will be part of GENCI, the Fre Read more…

By Tiffany Trader

Microsoft to Buy Mellanox?

December 20, 2018

Networking equipment powerhouse Mellanox could be an acquisition target by Microsoft, according to a published report in an Israeli financial publication. Microsoft has reportedly gone so far as to engage Goldman Sachs to handle negotiations with Mellanox. Read more…

By Doug Black

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This