Nov. 14 — At SC14, General Dynamics Advanced Information Systems will demonstrate how they were able to achieve 10x performance improvement in the advanced processing of very large and dynamic data sets by tailoring Apache Hama to run on a High Performance Computing (HPC) system.

General Dynamics Advanced Information Systems applies their more than 35 years of mission understanding and proven experience to harness the power of HPC by taking advantage of its processing power for real-time analysis and understanding of Big Data, allowing customers to respond to and execute on dynamic mission requirements

The increased performance is realized by customizing Apache Hama from the distributed programming model to the parallel programming model that is best utilized in HPC systems. This open source technology is now optimized to exploit the speed and power of HPC, providing a platform that keeps pace with the high volume of constantly changing data, transforming data into a competitive and mission advantage.

We display the data using a 3D visualization tool that allows users to look at vast quantities of data quickly, helping to accelerate discovery and insight.

To learn more about this project, William Leinberger with General Dynamics will be presenting “High Performance Data Analytics: Experiences Porting the Apache Hama Graph Analytics Framework to an HPC Infiniband Connected Cluster” on November 19, 2014 at 1:30 p.m.Central Time in Room 291.

—

Source: General Dynamics Advanced Information Systems