The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
August 17, 2009
University of California San Diego computer scientists present PortLand at SIGCOMM 2009
Aug. 17 -- University of California, San Diego computer scientists have created software that they hope will lead to datacenters that logically function as single, plug-and-play networks that will scale to the massive scale of modern datacenter networks. The software system -- PortLand -- is a fault-tolerant, layer 2 datacenter network fabric capable of scaling to 100,000 nodes and beyond. PortLand is fully compatible with existing hardware and routing protocols and holds promise for supporting large-scale, datacenter networks by increasing inherent scalability, providing baseline support for virtual machines and migration, and dramatically reducing administrative overhead. Critically, it removes the reliance on a single spanning tree, natively leveraging multipath routing and improving fault tolerance. The computer scientists report this advance in datacenter networking on August 18, 2009 at SIGCOMM, the premier computer networking conference.
"With PortLand, we came up with a set of algorithms and protocols that combine the best of layer 2 and layer 3 network fabrics," said Amin Vahdat, the senior author on the SIGCOMM paper and a computer science professor at UC San Diego's Jacobs School of Engineering. "Today, the largest datacenters contain over 100,000 servers. Ideally, we would like to have the flexibility to run any application on any server while minimizing the amount of required network configuration and state."
As mega datacenters handle more and more of the world's computing and storage needs, datacenter networking is becoming increasingly important, the computer scientists say. Loading the front page of any active Facebook user, for example, typically involves over 1,000 servers in 300 milliseconds or less.
Looking for ways to improve datacenter networking, Vahdat and his team of graduate students from the Jacobs School of Engineering revisited the long-standing trade-offs between layer 2 or Ethernet networks -- which route on MAC addresses -- and layer 3 networks -- which route on IP addresses.
Their result: PortLand, a system of algorithms and protocols that eliminates the scalability and routing-path limitations of existing layer 2 approaches and avoids the administrative and virtualization headaches caused by implementing layer 3 networks in datacenter environments.
Today's datacenters are often run on layer 3 networks, but this demands huge numbers of person-hours to set up and maintain the networks. Layer 3 networks also prohibit straightforward implementation of virtual machine migration -- limiting flexibility and efforts to reduce energy and cost in the datacenter.
"Our goal is to allow datacenter operators to manage their network as a single fabric," said Vahdat, who directs the Center for Network Systems at UC San Diego. "We are working toward a network that administrators can think of as one massive 100,000-port switch seamlessly serving over one million virtual endpoints."
Location Discovery
One of PortLand's key innovations is its location discovery protocol, which opens up the possibility of a scalable layer 2 network. Switches automatically learn their location within the datacenter topology without any human intervention. These switches, then, assign "Pseudo MAC" (PMAC) addresses to each of the servers they connect to. These PMAC addresses -- rather than MAC addresses -- are used internally in the network for packet forwarding.
Page: 1 of 3(Digg, Technorati, more)
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
The ACM Turing Award goes to the creator of the modern personal computer; and Voltaire announces a mid-range InfiniBand switch and new technology that accelerates distributed applications. We recap those stories and more in our weekly wrapup.
Read More...
The prospects for virtual SMP technology got another boost last month when Florida State University announced it had installed a new HPC system from 3Leaf Systems. The servers are being housed at the university's HPC facility and will be used across a range of scientific disciplines.
Read More...
For the first time in 62 years, the four-man Olympics bobsled team from the US captured the gold medal, setting a course world record in the process. The winning bobsled had some state-of-the-art engineering behind it, including CFD software from Exa Corporation. As it turned out, that software may have proved to be the margin of difference in the race.
Read More...
Mar 15 | The Register | EMC's grand vision for unified global storage. Read more...
Mar 15 | Data Center Knowledge | Company delivers UCS-container solution to NASA. Read more...
Mar 11 | Linux Magazine | CUDA may be the rage, but OpenCL is a standard that has some features you may need. Read more...
Mar 09 | Free Software Magazine | Data-driven computing will need open software. Read more...
Mar 09 | Bio-IT World | Tahoe Informatics founder eyes GPUs, CUDA software. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html