Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags
May 16, 2012

NVIDIA’s Bill Dally Talks 3D Chips and More at GTC

Robert Gelber

Bill Dally, NVIDIA’s chief scientist, spent some time speaking with EE Times at this year’s GPU Technology Conference (GTC) in San Jose, California. The two discussed 3D integrated circuits, the rise of China as a technology player, the state of US R&D spending and a possible alternative to Ethernet.

In the 3D chip realm, Dally sees a future where GPUs with several stacks of memory are integrated together. The design would potentially result in higher bandwidth communication, while consuming lower power per memory stack. But there seems to be a disagreement with NVIDIA and memory maker Micron, which looks to supply its own integrated 3D IC chip in the form of its Hybrid Memory Cube.

“What we want from a memory vendor is just the memory, and for them to please leave the processor design to us,” said Dally. “But they are trying to capture a bigger part of the value chain, so they insist on building a shim [logic] chip [as part of their memory stack].”

The current outlook for other memory alternatives is dim as Elpida, which has declared bankruptcy, was the only other vendor looking to supply 3D memory. Micron is interested in purchasing Elpida, so Dally is hoping a large manufacturer like Samsung will agree to create the needed memory.

When asked if China might build a rival GPU, the chief scientist didn’t deliver a direct answer, but described the country’s fast rate of progress as “frightening”. “Five years ago Godson was laughable,” said Dally. “Now it’s competent but not state of the art. If they continue, I would expect them to be matching the West in three to five years and then pulling ahead.”

Speaking to domestic R&D funding, Dally observed that the US has reduced investment in computing to a trickle. He said that innovation drives competitive products, which is only possible through government investment beyond what private companies are willing to spend. A specific example given was parallel computing and the general lack of knowledge surrounding the subject. Dally mentioned that programmers are still being educated to write serial code.

The conversation turned to Stanford and what Dally views as the University’s most promising research. He mentioned a program where researchers are looking to take supercomputing interconnect technology and deliver it to commercial datacenters. Stanford University has worked with Cray on the Dragonfly interconnect for the Cascade system and began pitching the technology to Google and Facebook. According to him, they loved the technology because of its low latency. The Stanford team plans to test the design on a small FPGA cluster and if everything goes as planned, they’ll start looking for a commercial adopter.

Full story at EE Times

SC14 Virtual Booth Tours

AMD SC14 video AMD Virtual Booth Tour @ SC14
Click to Play Video
Cray SC14 video Cray Virtual Booth Tour @ SC14
Click to Play Video
Datasite SC14 video DataSite and RedLine @ SC14
Click to Play Video
HP SC14 video HP Virtual Booth Tour @ SC14
Click to Play Video
IBM DCS3860 and Elastic Storage @ SC14 video IBM DCS3860 and Elastic Storage @ SC14
Click to Play Video
IBM Flash Storage
@ SC14 video IBM Flash Storage @ SC14  
Click to Play Video
IBM Platform @ SC14 video IBM Platform @ SC14
Click to Play Video
IBM Power Big Data SC14 video IBM Power Big Data @ SC14
Click to Play Video
Intel SC14 video Intel Virtual Booth Tour @ SC14
Click to Play Video
Lenovo SC14 video Lenovo Virtual Booth Tour @ SC14
Click to Play Video
Mellanox SC14 video Mellanox Virtual Booth Tour @ SC14
Click to Play Video
Panasas SC14 video Panasas Virtual Booth Tour @ SC14
Click to Play Video
Quanta SC14 video Quanta Virtual Booth Tour @ SC14
Click to Play Video
Seagate SC14 video Seagate Virtual Booth Tour @ SC14
Click to Play Video
Supermicro SC14 video Supermicro Virtual Booth Tour @ SC14
Click to Play Video