AMD Refreshes Vision for HPC Future

By Nicole Hemsoth

February 13, 2014

Although they’ve been rather quiet compared to their competitors in the general server, GPU and of course, overall HPC market, it might be too early to write off AMD just yet. If we’re to look at their silence as the “calm before the storm” consider it typhoon season, at least according Suresh Gopalakrishnan, corporate vice president and general manager of the AMD server business unit, whom we spoke with this week.

The last time we checked in with AMD, we were told that HPC represented a small share of the overall business focus. At the time, they had a dwindling share of the Top 500 (which hasn’t recovered—AMD claims less than 45 systems across processor generations on the list) and their focus seemed to be targeting anything but high performance computing workloads. But with stiff competition in the mainstream server market from the largely-dominant Intel, the drawn-out death of the PC, and a struggling presence in high-end computing, AMD did the smart thing—they branched out to tackle key segments of the market where they still have a chance. Among those areas is still the ARM server ecosystem—one that they’ll be aggressively attacking with their “Seattle” approach this year. Add to that their APU, which has an HSA shine for developers and a rather powerful GPU to exploit, and they might reclaim their status in an HPC ecosystem that’s moved on with rising shares of discrete GPUs and increasingly, coprocessors like the Xeon Phi.

With all of this in mind, during our chat this week, Gopalakrishnan told us that while their first generation APUs were unquestionably targeting graphics rendering, media and gaming markets, all roads for HPC now lead to “Berlin,” (which we’ll get to in a moment) and a strong ARM presence that’s sparked some surprising interest.

“When we first started talking about [codename Seattle and] ARM, the idea was around hyperscale, storage, cloud and such, but when we went to SC13, we were surprised at the interest from folks we met there who wanted to use ARM in HPC environments,” he revealed. “When we talked to those in Europe, we found that a lot of the research facilities there were also interested in ARM for HPC so a lot of them signed up for our evaluation boards.”

AMDInside1

“Seattle” is first to market with a 64-bit ARM-based server SoC from a proven server processor supplier.  As he described, “Seattle” is an 8 and then 16-core CPU based on the ARM Cortex-A57 core and is expected to run at or greater than 2 GHz and will offer two to four times the performance of the Opteron X-Series processor with significant improvement in compute-per-watt.” Additionally, Seattle is set to deliver 128GB DRAM support and “extensive offload engines for better power efficiency and reduced CPU loading, server caliber encryption, and compression and legacy networking including integrated 10GbE.  It will be the first processor from AMD to integrate AMD’s advanced Freedom Fabric for dense compute systems directly onto the chip.”

He said that this interest at SC and elsewhere made them realize that they have all the components—it’s a matter of wrapping an HPC message around what already exists. “The 1:1 disk to core ratio, 10GbE interconnects, and PCI 3 (for adding Inifiniband, for example) all made it a good fit for HPC.”

The other key to AMD’s HPC future in HPC is found in the x86-based Berlin processors, which are built on the “Steamroller” 28nm architecture, feature an integrated graphics unit that will support HSA, allowing unified GPU/CPU memory access.  “Berlin has a lot of graphics compute capabilities coming and it’s just the first in a series of processors that are HAS compliant with associated caching on the GPU side,” said Gopalakrishnan. He notes that initial interest in their APUs is coming from a range of potential areas, including the oil and gas industry (where there’s some stiff competition since many oil and gas shops were early CUDA adopters) as well as for those seeking a platform for Hadoop framework and machine learning or pattern recognition workloads.

BerlinProcessors

While AMD has only released their 2014 roadmap thus far, Gopalakrishnan says that further down the line, they’re planning on rolling out a steady stream of GPU capability increases that follow the same trajectory of their Radeon discrete GPUs. They’re also bolstering efforts on the developer ecosystem around their APU, by bringing new compilers from PGI and others, working to support OpenACC directives, partnering with SUSE for a GCC compiler to provide OpenMP directives and perhaps most important for their broader goals, working with Oracle to bring Java to entire GPU/CPU side.

Although the programmatic ease Gopalakrishnan talked about, enabled by HSA, is attractive, AMD is forever in a slow race with Intel, now especially in the accelerator/co-processor market. When asked about gaining an edge against the Phi, he said the question becomes one of making sure that the right task is being scheduled at the right point—as with Phi and you’re forced to take programming to that level. “Phi addresses one part of the programming ease issue, which is that you don’t need to use CUDA or OpenCL but instead x86 for the parallelization. Even still, you have to worry about separating the tasks, sending things to the right place and passing data back and forth between the two systems. We’re bringing the ability to be able to compile directly from Fortran, C or other high level languages to give OpenACC or OpenMP directives and be able to compile directly on the APU—in this way we’re making sure the scheduling is handled from the tool side and the memory accesses are within the same memory pool so to minimize passing.”

Gopalakrishnan  says the same concept applies to how they’re bringing Java into the fold. Almost all HPC apps are in C, Fortran or CUDA in conjunction with one of those. “We’re enabling Java onto the APUs and have been working with Oracle for many years on that. We released our own parallel API, which was the start for developers to use Java and GPU compute.” With the release of Java 9 these APIs will become part of the mesh. “We’re bringing an additional level of programming into this and seeing traction from people saying this opens up apps to more than just the traditional developers for future HPC applications.”

While much of this remains to be seen throughout 2014, it’s safe to say, “welcome back, AMD—the race has been quiet without you”….because the more competitor, the merrier, right?

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire