HPCwire: DARPA Places $44M Bet On Optical Interconnects

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

Leading HPC
Solution Providers

HPCwire >> Features

March 28, 2008

DARPA Places $44M Bet On Optical Interconnects

by Michael Feldman, HPCwire Editor

This week, the Defense Advanced Research Projects Agency (DARPA) awarded Sun Microsystems a five and a half year $44.3 million dollar contract to research and develop commercially viable optical interconnects for next generation multiprocessor systems. According to an article by John Markoff of the New York Times, the government selected Sun's proposal over three competing bids from Intel and HP; IBM; and MIT. For the contract, Sun will be partnering with Luxtera and Kotura, two silicon photonic vendors, to leverage their optical expertise. In addition, Stanford University and the University of California, San Diego will be collaborating on the work.

The DARPA program -- called Ultraperformance Nanophotonic Intrachip Communications (UNIC) -- has the goal of "demonstrating low power, high bandwidth, low latency intrachip photonic communication networks designed to enable chip multiprocessors with hundreds or thousands of compute cores to realize extremely high computational efficiency." The idea is to use the high bandwidth and low latency characteristics of photonics to create ultrascale chip grids -- 'macrochips' as Sun calls them. Combining scads of processors into one big virtual processor via high bandwidth links circumvents the yield problems encountered when chipmakers try to make the devices too big.

Part of the UNIC work will be derived from research connected to Sun's High Productivity Computing Systems (HPCS) Phase I and II work. When DARPA eliminated Sun from Phase III of the High Productivity Computing Systems (HPCS) program in November 2006, it seemed as though some of the company's research developed under the first two phases of the program might go for naught. But it looks like at least one piece of the HPCS work will provide a jumping off point for this new program. Macrochip

Sun's UNIC model is based on "proximity communications" technology that the company was pushing in their HPCS submission. That technology, which Sun says it is continuing to work on separately, allows adjacent chips to talk to each other via electromagnetic fields, instead of unwieldy, low bandwidth physical connections. One disadvantage of the proximity communications model is that it still relied on copper wires on the chips themselves to shuttle data around. So even though the chip-to-chip proximity communication latencies are low, for a really large grid of chips (think 100 x 100 processors), the on-chip latencies add up as you traverse the larger macrochip.

That's where silicon photonics has the advantage. The new project will use the proximity model, but substitute light waves for the longer wavelength electromagnetic waves to talk across the intrachip gap. And because optical waveguides can be built into the chips themselves, all communication across the grid can move at the speed of light -- at least ten times faster than electric signals over wires. Essentially, they're proposing a device in which they can route data across the entire chip grid via a series of photonic highways and bridges. That solves the latency problem. According to Ron Ho, one of the three Sun Distinguished Engineers on the project, they've already demonstrated this in the initial phase of the program.

With recent advances in nanophotonics, chipmakers can now pack multiple wavelengths of light into a single silicon waveguide, which gives you lots of bandwidth. On a per channel basis, a one quarter micron waveguide can handle up to 16 wavelengths of light, each achieving 15 Gb/s. So a single waveguide could handle over 200 Gb/s. If you aggregate 1,000 channels, running along the edge of the chip you can achieve 200 Tb/s.

The biggest challenge, says Ho, is energy consumption. To make any of this worthwhile, low-power photonics are required -- something currently missing from today's solutions. Intel's approach, which integrates the lasers themselves on-chip, is rather power hungry, so Sun is using the more conventional discrete laser approach. But even the power just to drive the on-chip optical links is rather high -- even slightly greater than that for serial communications used for memory communication channels, which is in the 20-25 mW/Gb/s range. For the UNIC work, Sun is aiming to lower power consumption by two orders of magnitude (100x lower).

According to Ho, the program was set up with very aggressive milestones. Even if they miss some of those, the Sun researchers believe they'll still be able to derive commercial success from the work. If the company manages to incorporate some of this technology into their UltraSPARC line in the next few years, they have a real shot at changing the game for high-end computers. But Ho admits they probably only have a 50-50 chance to achieve all the goals specified in the program.

"If you're going to be doing a project that's funded by DARPA, it had better be something sort of crazily aggressive," says Ho. "If it's something that's conservative and you're almost completely sure you're going to succeed, well that's probably not something DARPA should be funding."

Article Tools

Share Options

(Digg, Technorati, more)

Subscribe

Subscribe to HPCwire

Discussion

There are 0 discussion items posted.

Join the Discussion

You must be a registered user in order to comment on HPCwire stories.

Members enjoy:

	Access to Special Content, including Podcasts, Webcasts, and Whitepapers and more!
	Ability to take an active role in the discussions that are shaping the HPC technology discipline!
	Special offers available only to HPCwire members!

Become a Registered User Today!

Registered Users Log in Here to Comment

Email Address:	Password (case sensitive)

Remember me	Forgot Password?

RSS Feeds

Feeds by Topic

Feeds by Industry

Feeds by Content Type

Top Headlines

Building the Computer That Could Halt Nuclear Armageddon

Jul 06 | TechRadar | Breaking the exaflops barrier will help keep the nation's nuclear weapons safe. And that's just the start. Read more...

Cloudy With a Chance of HPC

Jul 01 | GenomeWeb Daily News | The popularity of cloud computing in the life sciences community was on full display at April's Bio-IT World conference. Read more...

HPC From the Beach

Jul 01 | Linux Magazine | How can getting to the ocean help with HPC computing? Read more...

DARPA Investigates Extreme Supercomputing

Jun 29 | GCN.com | Agency issues RFI for "Ubiquitous High Performance Computing" systems. Read more...

Supercomputers Go From Biggest to Cheapest

Jun 29 | Computerworld | The bottom of the TOP500 reveals the coming revolution in truly accessible high-end computing. Read more...

Read more headlines...

Featured Whitepapers

Building High Performance Computing in a Green and Modular Solution Building Block

Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.

View the White Paper Library

Multimedia

Webcast: Dell Expands HPC Access and Adoption with Intel Cluster Ready Program

Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell

Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.

Video White Paper: Architecting a Better Network Storage Solution

BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.

Webcast: HPC Development Solutions: Sun Studio & Sun HPC ClusterTools

Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.