The GPGPU Chronicles: NVIDIA Goes Personal; AMD Keeps Streaming

By Michael Feldman

November 18, 2008

New GPGPU computing platforms are in the works at NVIDIA and AMD. Riding the success of the CUDA software platform, NVIDIA has partnered with a number of OEMs and system integrators to offer Tesla-equipped personal supercomputers. These machines offer as much as 4 single precision teraflops of performance for the cost of a high-end workstation. Meanwhile, AMD has released its most powerful GPU computing board, the AMD FireStream 9270, and has also partnered with Silicon Valley startup Aprius to offer a 9.6 teraflop GPU expansion chassis.

First AMD. On Nov. 13, the company unveiled the FireStream 9270, which is essentially a high-end version of the FireStream 9250, AMD’s original double-precision GPU card for HPC. By cranking up the clock speed on the GPU, the new offering boasts 1.2 single precision (SP) teraflops and 240 double precision (DP) gigaflops — 20 percent greater than the 9250. With 2GB of GDDR5 memory, the new board doubles the memory capacity and nearly doubles of bandwidth of its predecessor. And at 160W, the new 9270 runs just a tad hotter than the 9250.

The increased memory brings it back in line with the original FireStream 9170 board, but it still has just half the memory capacity of the latest Tesla gear from NVIDIA. Memory capacity is a big deal in GPU acceleration since if the dataset doesn’t fit in local memory, the runtime system has to spend time shuffling data bytes back and forth between the CPU host and the accelerator board. If the GPU ends up waiting for data from the host, this negates some of speedup realized by offloading computing onto the graphics chip.

Like the FireStream 9250, the 9270 uses a compact form-factor and can slide into both workstations and servers — anything with a PCIe 2.0 x16 slot. The new card will retail for $1,499, and will start shipping in a few weeks. If you happen to be in Austin, Texas, this week for the SC08 conference, you can see one in action at AMD’s booth.

AMD will also be demonstrating a FireStream-based expansion box, which will start shipping in early 2009. Built by newcomer Aprius Inc., the Computational Acceleration System (CA8000) is a 4U box that can hold up to eight 9270 GPU boards, yielding an aggregate performance of 9.6 SP teraflops (1.9 DP teraflops). Up to 4 PCIe x16 buses connect the box to host servers, using optical interconnect technology developed by Aprius. Since the connection is optical fiber, the expansion box can use the full speed of the PCIe bus over distances of up to 50 meters. It’s meant to offer a lot of compute density, along with the flexibility of a standard host connection. According to Patricia Harrell, AMD’s director of Stream Computing, they’ve received a lot of interest from both end users and the tier one OEMs.

NVIDIA has no new Tesla gear lined up for SC08 this week, but the company has come up with a hardware reference platform that can be used to build Tesla-equipped personal supercomputers. Of course, researchers have been cobbling together GPU-accelerated workstations for awhile, but until now, users had no productized GPGPU desktop option other than PCs and workstations equipped with CUDA-compatible GPUs.

NVIDIA’s strategy seems to be to stake out the middle of the market between workstations and PCs sequestered for GPU computing and full-blown Tesla-accelerated clusters, like the 170 teraflop system just announced by Tokyo Tech. The Tesla personal supers can be used as development and test platforms for Tesla clusters or as HPC production systems in their own right.

Since the NVIDIA reference platform specifies multiple GPUs, a Tesla desktop system will be much more powerful than a single-GPU workstation. The minimum configuration for a Tesla-equipped personal supercomputer includes a quad-core CPU, 3 to 4 C1060 boards (each with a 10-series GPU), and 4 GB of memory per GPU. That would yield a machine capable of 4 SP teraflops and 400 DP gigaflops. These personal systems should retail for around $10,000. According to Sumit Gupta, senior product manager at NVIDIA, the new Tesla-equipped machines will be “to supercomputing what PCs are to computers.”

NVIDIA believes the personal supercomputer market is around 15 million researchers, nearly 6 million of which are in the US alone. Certainly, many HPC stalwarts think GPUs have earned their place in the supercomputing ecosystem. Jack Dongarra at the University of Tennessee said that GPUs are now suitable for real-world application adding: “Future computing architectures will be hybrid systems with parallel-core GPUs working in tandem with multi-core CPUs.” Microsoft’s Burton Smith is convinced that desktop supercomputing is for real this time around, noting that “[h]eterogeneous computing is what makes such a breakthrough possible.”

NVIDIA has managed to attract some notable vendors, including Dell, Penguin Computing, Colfax International, Western Scientific, BOXX, Lenovo, ASUS, and a number of others. The desktop offerings will be sold under their respective brands, but NVIDIA will direct potential customers to its partners via its own Tesla Web site.

It’s interesting to see players that are relatively new to HPC, like ASUS and Lenovo, now offering personal HPC systems. In October, I reported that high-end PC maker Velocity Micro (also a launch partner for NVIDIA) had introduced its Tesla-equipped personal system. At the time, I wondered if other desktop vendors would jump into the GPGPU fray. I guess I have my answer.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Mystery Solved: Intel’s Former HPC Chief Now Running Software Engineering Group 

April 15, 2024

Last year, Jeff McVeigh, Intel's readily available leader of the high-performance computing group, suddenly went silent, with no interviews granted or appearances at press conferences.  It led to questions -- what's Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Institute for Human-Centered AI (HAI) put out a yearly report to t Read more…

Crossing the Quantum Threshold: The Path to 10,000 Qubits

April 15, 2024

Editor’s Note: Why do qubit count and quality matter? What’s the difference between physical qubits and logical qubits? Quantum computer vendors toss these terms and numbers around as indicators of the strengths of t Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips are available off the shelf, a concern raised at many recent Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announced its second fund targeting €200 million. The very idea th Read more…

Nvidia’s GTC Is the New Intel IDF

April 9, 2024

After many years, Nvidia's GPU Technology Conference (GTC) was back in person and has become the conference for those who care about semiconductors and AI. In a way, Nvidia is the new Intel IDF, the hottest chip show Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announce Read more…

Nvidia’s GTC Is the New Intel IDF

April 9, 2024

After many years, Nvidia's GPU Technology Conference (GTC) was back in person and has become the conference for those who care about semiconductors and AI. I Read more…

Google Announces Homegrown ARM-based CPUs 

April 9, 2024

Google sprang a surprise at the ongoing Google Next Cloud conference by introducing its own ARM-based CPU called Axion, which will be offered to customers in it Read more…

Computational Chemistry Needs To Be Sustainable, Too

April 8, 2024

A diverse group of computational chemists is encouraging the research community to embrace a sustainable software ecosystem. That's the message behind a recent Read more…

Hyperion Research: Eleven HPC Predictions for 2024

April 4, 2024

HPCwire is happy to announce a new series with Hyperion Research  - a fact-based market research firm focusing on the HPC market. In addition to providing mark Read more…

Google Making Major Changes in AI Operations to Pull in Cash from Gemini

April 4, 2024

Over the last week, Google has made some under-the-radar changes, including appointing a new leader for AI development, which suggests the company is taking its Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

Leading Solution Providers

Contributors

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

Intel’s Xeon General Manager Talks about Server Chips 

January 2, 2024

Intel is talking data-center growth and is done digging graves for its dead enterprise products, including GPUs, storage, and networking products, which fell to Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire