The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
June 16, 2008
BLACKSBURG, Va., June 16 -- Pavan Balaji of Argonne National Laboratory and Wu Feng of the Department of Computer Science in Virginia Tech's College of Engineering led an international team of researchers that received the International Supercomputing Conference 2008 Distinguished Paper Award.
The paper, "Distributed I/O with ParaMEDIC: Experiences with a Worldwide Supercomputer," takes a new and non-traditional approach to what has been considered an elusive holy grail in high performance computing. I/O stands for "Input/Output" in a computing system.
Despite enhancements by the information technology field in network hardware as well as network and input/output software stacks, achieving scalable high performance remains a challenge. In Balaji and Feng’s paper, a worldwide team took a completely new and non-traditional approach to distributed I/O that the pair dubbed "ParaMEDIC" or "Parallel Metadata Environment for Distributed Input/Output and Computing." ParaMEDIC leverages application-specific transformation of data to create orders-of-magnitude smaller meta-data for significantly more efficient input/output processing.
Specifically, the paper details the team's experiences in deploying a large-scale system to facilitate the discovery of missing genes in the 567 completed microbial genomes, as of October 2007, from the National Center for Biotechnology Information’s Entrez Repository. This repository has since grown to 699 microbial genomes. Given that the repository is growing at such a rapid rate, the task of discovering missing genes has become computationally more difficult; solving such a problem oftentimes exceeds the computational and storage resources of any one supercomputing site.
With respect to discovering missing genes, João Setubal, associate professor and deputy director of the Virginia Bioinformatics Institute at Virginia Tech, notes that most of the genomes completed to date have had their genes detected by gene-finder programs, which may miss real genes. "One way to discover these missed genes is by similarity computations," said Setubal. "If enough computer power is available, every possible location along a genome can be checked for the presence of genes. That is exactly what the ParaMEDIC team has done by leveraging the mpiBLAST sequence-search program."
Balaji and Feng's project involved nine different computational sites spread across the United States and generated a petabyte of data that was "teleported" to a single large-scale facility in Tokyo for storage. A petabyte is equal to one quadrillion bytes of storage, which is roughly equivalent to the content of 50 Libraries of Congress or a stack of 212,766 DVDs that measures about 840 feet in height.
Major contributions to the paper were also made by Heshan Lin, a Ph.D. student from North Carolina State University who is interning with Feng this summer and Jeremy Archuleta, a Ph.D. student co-advised by Feng and who is an Institute for Critical Technology and Applied Science Fellow at Virginia Tech.
The International Supercomputing Conference event has evolved over the years into the Annual International Supercomputing Conference featuring a prestigious high-performance computing exhibition and conference, drawing expert speakers, exhibitors, researchers, information technology managers, and students from all over the world -- thus providing a unique platform for connecting the high-performance computing community on a global scale.
This conference also marks the first of two releases of the TOP500 List every year. The TOP500 is a list of the most powerful supercomputers in the world, ranked by their performance on the Linpack benchmark. Virginia Tech’s System X supercomputer, now four years old, still resides on this list.
-----
Source: Christina Daniilidi, Virginia Tech
Interview: Appro CEO Shares HPC Vision
Appro CEO Daniel Kim provides a glimpse into Appro's vision and opportunities for its supercomputer and high-performance cluster solutions.
Minnesota-based North Star Imaging, a firm that specializes in industrial X-rays for nondestructive testing and analysis, is employing NVIDIA GPUs to accelerate 3D renderings in their CT (computed tomography) software. Julien Noel, the company's CT product manager, says the exceptional computational power afforded by CUDA and Tesla hardware is increasing customer productivity and transforming their workflow.
Read More...
For the humanities scholar who may have only recently mastered library and archival finding aids beyond the archaic card catalog, the possibility of retrieving source materials at the flash of a keystroke (well maybe a few...) is very heady stuff.
Read More...
The "cloud" model of exporting user workload and services to remote, distributed and virtual environments is emerging as a powerful computing paradigm. Yet, one domain that challenges this model in its characteristics and needs is high performance computing.
Read More...
Nov 28 | People's Daily Online | Currently under development, the Dawning 6000 HPC system will be based on the Chinese-made "Loongson" microprocessor. Read more...
Nov 27 | Computerworld | The use of supercomputers to increase the industrial might of the U.S. has amounted to little more than an asterisk from a financial standpoint in both the federal budget and the economy as a whole. Read more...
Nov 26 | Science Business | IBM is getting ready to set up a supercomputing research “collaboratory” in Dublin, Ireland. Read more...
Nov 25 | The Register | A Rice University professor believes that his proposed graphene arrays could be many times denser and faster than existing storage tech, and they'd be more reliable too. Read more...
Nov 24 | The New York Times | Server maker Super Micro Computer lives by two principles: give customers what they want, and do it as fast as humanly possible. Read more...
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Get updates and insights on the High Productivity Computing industry delivered driectly to your inbox.