Visit additional Tabor Communication Publications
February 09, 2011
Next week the IBM supercomputer known as "Watson" will take on two of the most accomplished Jeopardy players of all time, Ken Jennings and Brad Rutter, in a three-game match starting on February 14. If Watson manages to best the humans, it will represent the most important advance in machine intelligence since IBM's "Deep Blue" beat chess grandmaster Garry Kasparov in 1997. But this time around, the company also plans to make a business case for the technology. Trivial pursuit this is not.
And impressive technology it is. On the hardware side, Watson is comprised of 90 Power 750 servers, 16 TB of memory and 4 TB of disk storage, all housed in a relatively compact ten racks. The 750 is IBM's elite Power7-based server targeted for high-end enterprise analytics. (The Power 755 is geared toward high performance technical computing and differs only marginally in CPU speed, memory capacity, and storage options.) Although the enterprise version can be ordered with 1 to 4 sockets of 6-core or 8-core Power7 chips, Watson is maxed out with the 4-socket, 8-core configuration using the top bin 3.55 GHz processors.
The 360 Power7 chips that make up Watson's brain represent IBM's best and brightest processor technology. Each Power7 is capable of over 500 GB/second of aggregate bandwidth, making it particularly adept at manipulating data at high speeds. FLOPS-wise, a 3.55 GHz Power7 delivers 218 Linpack gigaflops. For comparison, the POWER2 SC processor, which was the chip that powered cyber-chessmaster Deep Blue, managed a paltry 0.48 gigaflops, with the whole machine delivering a mere 11.4 Linpack gigaflops.
But FLOPS are not the real story here. Watson's question-answering software presumably makes little use of floating-point number crunching. To deal with the game scenario, the system had to be endowed with a rather advanced version of natural language processing. But according to David Ferrucci, principal investigator for the project, it goes far beyond language smarts. The software system, called DeepQA, also incorporates machine learning, knowledge representation, and deep analytics.
Even so, the whole application rests on first understanding the Jeopardy clues, which, because they employ colloquialisms and often obscure references, can be challenging even for humans. That's why this is such a good test case for natural language processing. Ferrucci says the ability to understand language is destined to become a very important aspect of computers. "It has to be that way," he says. "We just cant imagine a future without it."
But it's the analysis component that we associate with real "intelligence." The approach here reflects the open domain nature of the problem. According to Ferrucci, it wouldn't have made sense to simply construct a database corresponding to possible Jeopardy clues. Such a model would have supported only a small fraction of the possible topics available to Jeopardy. Rather their approach was to use "as is" information sources -- encyclopedias, dictionaries, thesauri, plays, books, etc. -- and make the correlations dynamically.
The trick of course is to do all the processing in real-time. Contestants, at least the successful ones, need to provide an answer in just a few seconds. When the software was run on a lone 2.6 GHz CPU, it took around 2 hours to process a typical Jeopardy clue -- not a very practical implementation. But when they parallelized the algorithms across the 2,880-core Watson, they were able to cut the processing time from a couple of hours to between 2 and 6 seconds.
Even at that, Watson doesn't just spit out the answers. It forms hypotheses based on the evidence it finds and scores them at various confidence levels. Watson is programmed not to buzz in until it reaches a confidence of at least 50 percent, although this parameter can be self-adjusted depending on the game situation.
To accomplish all this, DeepQA employs an ensemble of algorithms -- about a million lines of code --- to gather and score the evidence. These include temporal reasoning algorithms to correlate times with events, statistical paraphrasing algorithms to evaluate semantic context, and geospatial reasoning to correlate locations.
It can also dynamically form associations, both in training and at game time, to connect disparate ideas. For example it can learn that inventors can patent information or that officials can submit resignations. Watson also shifts the weight it assigns to different algorithms based on which ones are delivering the more accurate correlations. This aspect of machine learning allows Watson to get "smarter" the more it plays the game.
The DeepQA programmers have also been refining the algorithms themselves over the past several years. In 2007, Watson could only answer a small fraction of Jeopardy clues with reasonable confidence and even at that, was only correct 47 percent of the time. When forced to answer the majority of the clues, like a grand champion would, it could only answer 15 percent correctly. By IBM's own admission, Watson was playing "terrible." The highest performing Jeopardy grand champions, like Jennings and Rutter, typically buzz in on 70 to 80 percent of the entries and give the correct answer 85 to 95 percent of time.
By 2010 Watson started playing at that level. Ferrucci says that while the system can't buzz in on every question, it can now answer the vast majority of them in competitive time. "We can compete with grand champions in terms of precision, in terms of confidence, and in terms of speed," he says.
In dozens of practice rounds against former Jeopardy champs, the computer was beating the humans with a 65 percent win rate. Watson also prevailed in a 15-question round against Jennings and Rutter in early January of this year. See the performance below.
None of this is a guarantee that Watson will prevail next week. But even if the machine just makes a decent showing, IBM will have pulled off quite possibly the best product placement in television history. Open domain question answering is not only one of the Holy Grails of artificial intelligence but has enormous potential for commercial applications. In areas as disparate as healthcare, tech support, business intelligence, security and finance, this type of platform could change those businesses irrevocably. John Kelly, senior vice president and director of IBM Research, boasts, "We're going to revolutionize industries at a level that has never been done before."
In the case of healthcare, it's not a huge leap to imagine "expert" question answering systems helping doctors with medical diagnosis. A differential diagnosis is not much different from what Watson does when it analyzes a Jeopardy clue. Before it replaces Dr. House, though, the machine will have to prove itself in the game show arena.
If Jennings and Rutter defeat the supercomputer this time around, IBM will almost certainly ask for a rematch, as it did when Deep Blue initially lost its first chess match with Kasparov in 1996. The engineers will keep stroking the code and retraining the computer until Watson is truly unbeatable. Eventually the machine will prevail.
For a broader discussion on this topic between the author and InterSect360 Research CEO Addison Snell, download this week's HPCwire Soundbite podcast.
May 23, 2013 |
The study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
May 22, 2013 |
At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
May 10, 2013 |
Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.