HPCwire: The New Science of Visual Analytics

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

Leading HPC
Solution Providers

HPCwire >> Features

May 15, 2008

The New Science of Visual Analytics

by John E. West, for HPCwire

Over his 30 year career, Jim Thomas has specialized in the research and implementation of tools in scientific visualization, multimedia, and human computer interaction designed to increase the bandwidth of the connection between humans and the data they are trying to understand. Thomas has chaired graphics and visualization conferences for both ACM and IEEE, is the former editor-in-chief for IEEE Computer Graphics and Applications, and is on science and technology boards for universities, states, and industry. In short, Thomas has a passion for helping people understand what's in their data.

But his most recent effort goes beyond creating new techniques within old disciplines -- with his work in visual analytics, Thomas, Director of the National Visualization and Analytics Center (NVAC), has helped launched a new science that engages "...the human mind in a way that's fundamentally different from the way we have done things," as he puts it.

What is visual analytics? According to Thomas, "Visual analytics is the science of analytical reasoning facilitated by interactive visual interfaces." It is traditional scientific visualization, taken to the next level. In "Challenges in Visual Data Analysis" (2006), Keim and his co-authors note that visual analytics combines visualization with human factors, information, geospatial, and scientific analytics. As pointed out in that paper, "Especially human factors (e.g., interaction, cognition, perception, collaboration, presentation, and dissemination) play a key role in the communication between human and computer, as well as in the decisionmaking process."

An example? Consider the news stream at CNN.com and imagine that you are an analyst employed by Amalgamated Office Buildings to monitor what your competition, ACME Builders, is up to. You might be interested in news about big real estate deals, large purchases of steel, new metropolitan construction projects, and so on. But ACME is smart, and they know not to let news of their future projects into the press before they have the contract. There are clues, and any of these news stories individually might give a hint about what your competition is doing. The whole story, however, won't be clear until you put all the pieces together.

So your job, as Amalgamated's analyst, is to find the stories that reveal clues to ACME's strategy in CNN's massive news stream, and then put those clues together in a way that reveals what they are up to. Since you don't know anything in advance, however, this is a lot like piecing together a puzzle where not only do you not know what the final picture looks like, you don't even know where the pieces are.

Oh, and by the way, the news streams at NBC.com, ABCnews.com, and thousands of other news sites, blogs, podcasts, and videos on the Web have other clues that you'll need to get an accurate picture. Good luck!

This kind of example is repeated countless times in border security, customs control, national security, disaster planning, crisis management, and so on. And this is the kind of problem that visual analytics in meant to solve. By using advanced computer-based analysis, graphics, and human-computer interaction techniques, visual analytics helps people sift through mountains of information to find individual pieces of a picture, and then helps them put that picture together.

One of the organizing forces for visual analytics activity in the United States and internationally is the National Visualization and Analytics Center, sponsored by the US Department of Homeland Security and headed up by Jim Thomas. The center, housed at Pacific Northwest National Laboratory and started in 2004, was created to develop and implement new techniques to help analysts, decision makers, and crisis responders manage the large volumes of unstructured information that can help maintain the security of the United States and its infrastructure in the face of potential threats and disasters.

The center has a far reach and broad scope, with both research and applied sides. The overall mission of the NVAC is described in its five primary charters: reduce the threat of terrorism; understand the risks to and vulnerabilities of our critical infrastructure; develop a visual communication infrastructure for response teams; create effective communications metaphors that can capture not only the conclusions of risk assessments, but also the evidence and chain of logic; and create an enduring talent base.

According to Thomas, about half of NVAC's funding goes to basic research through five university-led research centers. Each center has a regional partner that helps to focus its work: Stanford, partnered with the regional FBI office; the University of North Carolina at Charlotte, partnered with the Bank of America; Purdue University, partnered with the Indiana University School of Medicine; Pennsylvania State University, partnered with the New York Port Authority; and the University of Washington, partnered with institutions around the Pacific rim. Each of these university research centers works on issues of specific interest to its partners; collectively, they advance the state of the art for the entire discipline.

The rest of NVAC's efforts are directed to creating the techniques, and fielding the products, to help the nation's infrastructure protection and response teams prevent, predict and manage crises. These products are where the rubber meets the road for what Thomas describes as "the new science of interaction," with sophisticated reasoning and decision support tools wrapped in interfaces that are designed to be "walk up usable."

Customers for NVAC's products include the customs officials managing the stream of goods and people across our borders, intelligence analysts mining the rich but noisy streams of information on the Web, infrastructure protection teams, first responders managing a crisis as it unfolds, and many others. For these audiences, Thomas says it is critical to display the information in a context that is relevant to individual users. For example, professional analysts are accustomed to dealing with news flows represented as a visual landscape, with thematic areas shown as hills and mountains that grow and shrink with the volume of coverage in those areas. Power grid operators on the other hand, benefit from overlaying information about the grid on a geographical representation that puts the data in its physical location.

However it is not just the visual display but the interaction, or the "discourser of discovery," as Thomas puts it, that enables discovery, understanding and confirmation.

Given all the attention on national security in NVAC's mission, you might imagine that a good bit of what they do will remain trapped under a classified sticker for most of its useful life. Not so, says Thomas. There are about 200 projects in the US sponsored by NVAC, and publishing is encouraged in the open literature and in the six international conferences on visual analytics that happen every year. "Only about 5 percent of what we do is classified," says Thomas.

When it comes to catalyzing growth in this new field, NVAC and its broad team of partners at PNNL, government agencies, academia, and industry are clearly accomplishing their goals. Thomas says that the field has grown from 40 researchers just a few years ago to over 1,000 researchers today, from all over the world. NVAC is also a "strong business area" for PNNL, bringing in roughly $25 million over four years. But these successes are only part of the picture. Through summer camps, research partnerships, and educational outreach, the center is looking out decades into the future to ensure that there is a talent base over the long term, helping to advance and refine this field. With no end in sight to the growth of data available in our society, these researchers are going to be sorely needed.

Article Tools

Share & Save Options

Discussion

There are 0 discussion items posted.

Join the Discussion

You must be a registered user in order to comment on HPCWire stories.

Members enjoy:

	Access to Special Content, including Podcasts, Webcasts, and Whitepapers and more!
	Ability to take an active role in the discussions that are shaping the HPC technology discipline!
	Special offers available only to HPCWire members!

Become a Registered User Today!

Registered Users Log in Here to Comment

Email Address:	Password (case sensitive)

Remember me	Forgot Password?

RSS Feeds

Feeds by Topic

Feeds by Industry

Feeds by Content Type

Top Headlines

25 Years of Conventional Evaluation of Data Analysis Proves Worthless In Practice

Sep 05 | Uppsala University | Swedish researchers are revealing that "intelligent" computer-based methods for classifying patient samples is worthless when it comes to practical problems. Read more...

Three Dimensional Scans Could Revolutionise Brain Surgery

Sep 03 | Telegraph.co.uk | A new form of three dimensional scans could revolutionise brain surgery within a year, doctors claim. Read more...

Marching Penguins: Monitoring Your HPC Cluster

Sep 03 | Linux Magazine | In HPC, most attention is paid to utilization and performance, rather than service availability and problem notification. This article focuses on the latter Read more...

Big Data: Welcome to the Petacentre

Sep 03 | Nature News | What does it take to store bytes by the tens of thousands of trillions? Read more...

UD Scientist Finds Quicker Computer On-Ramp

Sep 01 | Delaware Online | In the world of supercomputer-powered science, speed is everything, and an open road can lead to the promised land. Read more...

Read more headlines...

Featured Whitepapers

SUSE® Linux Enterprise Server for High Performance Computing

Sep 05 | | The excellent scalability features of Linux, in addition to robust security and performance makes it an excellent choice for server systems, especially in the high performance computing area.

“Going Parallel - An Implementation Guide”

Sep 01 | | The paper outlines the basic steps and tools involved in the process of migrating a desktop application to a parallel environment.

Improving Performance and Manageability for Seismic Processing and Imaging Applications with Parallel Storage

Jun 05 | | As pressure increases on the upstream seismic processing community to deliver ever-higher levels of productivity and efficiency, a new generation of storage solutions will be required that allow the maximum utilisation of high-performance computing (HPC) Linux cluster resources, together with the minimum of management overhead.

View the White Paper Library

Multimedia

Video White Paper: Architecting a Better Network Storage Solution

BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.

Podcast: Interview with Ben Bennett of ClearSpeed Technology

Today, HPC organizations are requiring substantially more floating point performance to solve real-world problems. In this podcast, Ben Bennett, ClearSpeed General Manager, discusses how acceleration technology can improve the overall performance of standard x86-based systems...