Visit additional Tabor Communication Publications
April 23, 2012
ARGONNE, Ill., April 18 -- Researchers at the U.S. Department of Energy’s (DOE) Argonne National Laboratory have received part of a planned $25 million grant from the DOE Office of Science to tackle the problem of extracting knowledge from massive data sets.
The work is part of the DOE’s newly established Scalable Data Management, Analysis, and Visualization (SDAV) Institute. Researchers in Argonne’s Mathematics and Computing Science division will receive a planned $3.4 million over five years for the research.
New computing advances are enabling researchers to attack important problems, from increasing the fuel efficiency of vehicles to making more aerodynamic airplane wings. The result is a veritable “tsunami of data.” Many simulations and experiments already generate petabytes of data—a single petabyte is 2,000 times more data than you can fit on a typical laptop—and they will soon be generating exabytes.
“The task of handling this data is overwhelming, forcing scientists to spend much of their time developing special-purpose solutions to store, access and manage the information,” said Robert Ross, Argonne computer scientist and deputy director of the new institute. “The SDAV teams will develop the necessary tools and software so that scientists can use their time more effectively for scientific investigation and discovery.”
The institute will address challenges in three areas. Data management enables query of scientific datasets; data analysis provides techniques for both in situ and postprocessing data analysis; and data visualization includes tools for identifying and understanding features in multiscale, multiphysics datasets.
The SDAV Institute was announced at the White House on March 29 as part of a new $200 million Big Data Research and Development Initiative. Funded under the DOE Office of Science’s Scientific Discovery through Advanced Computing (SciDAC) program, the institute is led by Lawrence Berkeley National Laboratory (LBNL). In addition to Argonne and LBNL, four other national laboratories, as well as seven universities and one visualization software company, are participating in the collaboration.
“To make all this possible, we will actively work with applications teams, assisting them with the tools and ensuring that our efforts meet the high standards needed to ensure correctness and performance of the scientists’ codes,” said Ross. “In turn, we will gain critical feedback about scientists’ needs in addressing mission-critical challenges.”
Essential to successful deployment and adoption of SDAV tools are close ties to leading computational facilities. The institute includes partners from the Argonne Leadership Computing Facility, the National Energy Research Scientific Computing Center at LBNL and the Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory, who are responsible for installing the new technologies developed by the SDAV teams. All three supercomputing facilities are supported by DOE’s Office of Science. These partners will also inform SDAV team members of upcoming system architectures, guiding development of SDAV tools to ensure that they will be effective as new systems come online.
To reach an even broader community, the SDAV team plans to hold tutorials and workshops to gather information from other researchers and train potential users. These efforts will be coordinated with leading conferences and DOE computing facility activities.
SDAV combines the expertise from three successful SciDAC Centers and Institutes: the SciDAC Scientific Data Management Center for Enabling Technologies, the Visualization and Analytics Center for Enabling Technologies and the Institute for Ultra-Scale Visualization.
“Our successes in those earlier SciDAC programs provide the knowledge needed to achieve breakthrough science in this data-rich era,” said Ross.
Argonne National Laboratory seeks solutions to pressing national problems in science and technology. The nation's first national laboratory, Argonne conducts leading-edge basic and applied scientific research in virtually every scientific discipline. Argonne researchers work closely with researchers from hundreds of companies, universities, and federal, state and municipal agencies to help them solve their specific problems, advance America's scientific leadership and prepare the nation for a better future. With employees from more than 60 nations, Argonne is managed by UChicago Argonne, LLC for the U.S. Department of Energy's Office of Science.
DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit science.energy.gov.
Source: Argonne National Laboratory
Contributing commentator, Andrew Jones, offers a break in the news cycle with an assessment of what the national "size matters" contest means for the U.S. and other nations...
Today at the International Supercomputing Conference in Leipzing, Germany, Jack Dongarra presented on a proposed benchmark that could carry a bit more weight than its older Linpack companion. The high performance conjugate gradient (HPCG) concept takes into account new architectures for new applications, while shedding the floating point....
Not content to let the Tianhe-2 announcement ride alone, Intel rolled out a series of announcements around its Knights Corner and Xeon Phi products--all of which are aimed at adding some options and variety for a wider base of potential users across the HPC spectrum. Today at the International Supercomputing Conference, the company's Raj....
Jun 18, 2013 |
The world's largest supercomputers, like Tianhe-2, are great at traditional, compute-intensive HPC workloads, such as simulating atomic decay or modeling tornados. But data-intensive applications--such as mining big data sets for connections--is a different sort of workload, and runs best on a different sort of computer.
Jun 18, 2013 |
Researchers are finding innovative uses for Gordon, the 285 teraflop supercomputer housed at the San Diego Supercomputer Center (SDSC) that has a unique Flash-based storage system. Since going online, researchers have put the incredibly fast I/O to use on a wide variety of workloads, ranging from chemistry to political science.
Jun 17, 2013 |
The advent of low-power mobile processors and cloud delivery models is changing the economics of computing. But just as an economy car is good at different things than a full size truck, an HPC workload still has certain computing demands that neither the fastest smartphone nor the most elastic cloud cluster can fulfill.
Jun 14, 2013 |
For all the progress we've made in IT over the last 50 years, there's one area of life that has steadfastly eluded the grasp of computers: understanding human language. Now, researchers at the Texas Advanced Computing Center (TACC) are utilizing a Hadoop cluster on its Longhorn supercomputer to move the state of the art of language processing a little bit further.
Jun 13, 2013 |
Titan, the Cray XK7 at the Oak Ridge National Lab that debuted last fall as the fastest supercomputer in the world with 17.59 petaflops of sustained computing power, will rely on its previous LINPACK test for the upcoming edition of the Top 500 list.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?
Join our webinar to learn how IT managers can migrate to a more resilient, flexible and scalable solution that grows with the data center. Mellanox VMS is future-proof, efficient and brings significant CAPEX and OPEX savings. The VMS is available today.