Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags
February 14, 2011

Open Source Key to Jeopardy Supercomputer Battle

Nicole Hemsoth

In advance of the much-anticipated event beginning tonight as IBM’s Watson supercomputer takes on human champions, Ken Jennings and Brad Rutter, the Apache Software Foundation shed light on the role of its open source software, Hadoop, that gives order to Watson’s “brain.”

Hadoop is most frequently discussed in HPC in the Cloud because of its relevance to cloud computing, however it is worth noting that the software is also playing a key role in tonight’s championship to “enable Watson to access, sort, and process data in a massively parallel system (90+ server cluster/2,880 processor cores, 16 terabytes of RAM/4 terabytes of disk storage).”

Hadoop is open source software that allows for complex parallel processing tasks by providing the critical software framework that allows distributed data-intensive applications to work across thousands of nodes and petabytes of data. In the case of the IBM supercomputer as it battles it human opponents on Jeopardy, powerful software is required to manage the complex demands for sorting through data.

Apache hopes to show that open source software is capable of handling intense workloads and like IBM, is glad for the opportunity to expose mainstream audiences to concepts that might be just on the edge of notice, including supercomputer capabilities and open source packages they might never have heard of–even if their business could benefit from one or both.

During the Jeopardy competition, IBM’s supercomputer, Watson, will be humming away at 80 trillion operations per second, instantly accessing vast libraries of information against millions of logic rules to achieve correct responses to questions posed in natural speech. 

Jim Lagielski, President of the Apache Software Foundation remarked that the Jeopardy showdown demonstrates the power of open source software products, noting that “the success and influence of Watson clearly shows that open source in general, and specifically open source software developed and released by the Apache Software Foundation, is deeply entwined in all layers and aspects of technology…” and that it is “part of computing and information technology DNA, forming complete or integral solutions to advanced problems.”

Full story at Apache Software Foundation

SC14 Virtual Booth Tours

AMD SC14 video AMD Virtual Booth Tour @ SC14
Click to Play Video
Cray SC14 video Cray Virtual Booth Tour @ SC14
Click to Play Video
Datasite SC14 video DataSite and RedLine @ SC14
Click to Play Video
HP SC14 video HP Virtual Booth Tour @ SC14
Click to Play Video
IBM DCS3860 and Elastic Storage @ SC14 video IBM DCS3860 and Elastic Storage @ SC14
Click to Play Video
IBM Flash Storage
@ SC14 video IBM Flash Storage @ SC14  
Click to Play Video
IBM Platform @ SC14 video IBM Platform @ SC14
Click to Play Video
IBM Power Big Data SC14 video IBM Power Big Data @ SC14
Click to Play Video
Intel SC14 video Intel Virtual Booth Tour @ SC14
Click to Play Video
Lenovo SC14 video Lenovo Virtual Booth Tour @ SC14
Click to Play Video
Mellanox SC14 video Mellanox Virtual Booth Tour @ SC14
Click to Play Video
Panasas SC14 video Panasas Virtual Booth Tour @ SC14
Click to Play Video
Quanta SC14 video Quanta Virtual Booth Tour @ SC14
Click to Play Video
Seagate SC14 video Seagate Virtual Booth Tour @ SC14
Click to Play Video
Supermicro SC14 video Supermicro Virtual Booth Tour @ SC14
Click to Play Video