Tag: Hadoop

New Models for Research, Part III – Embracing the Big Data Stack

Mar 30, 2015 |

In the third of a four-part installation, Jay Etchings, director of operations for research computing, and senior HPC architect at Arizona State University, explores the brave new world of open big data alternatives to traditional bare metal HPC+MPI+InfiniBand for research computing.

The Best of HPC in 2014

Jan 27, 2015 |

As we turn the page to 2015, we’re taking a look back at the top stories from 2014 to reflect on just how far the fastest machines in the world (and the people who run them) have come within only 12 months. From the blending of big data and HPC to hardware breakthroughs, 2014 points Read more…

Tulane Accelerates Discovery with Hybrid Supercomputer

Dec 16, 2014 |

The rich culture and distinctive charm of the city of New Orleans served as the backdrop for this year’s annual Supercomputing Conference (SC14). If you haven’t been before, residents of the Big Easy will urge you to visit the uptown campus of Tulane University. Renowned for its beautiful trees and landscaping, the university is also a prominent Read more…

Cray Launches Hadoop into HPC Airspace

Oct 15, 2014 |

There has been little doubt that the convergence of traditional high performance computing with advanced analytics has been steadily underway, fed in part by a rush of new tools, frameworks and platforms targeting the big data deluge. And when one thinks about the old guard of supercomputing, Cray is one of the first vendors to Read more…

HPC and Big Data: A “Best of Both Worlds” Approach

Mar 31, 2014 |

While they may share a number of similar, overarching challenges, data-intensive computing and high performance computing have some rather different considerations, particularly in terms of management, emphasis on performance, storage and data movement. Still, there is plenty of room for the two areas to merged, according to Indiana University’s Dr. Geoffrey Fox. Fox and his Read more…

Shaking the HPC In-Memory Stack

Mar 3, 2014 |

Many who have been in HPC for a number of years will remember GridGain, the in-memory computing company that has found success at a number of commercial and academic high performance computing sites since its official launch in 2010—an effort backed with an initial $2.5 million investment, followed by another boost last year with a Read more…

Adapting Hadoop to HPC Environments

Feb 14, 2014 |

MapReduce is well known for its relative ease of use in today’s ubiquitous world of parallelism. The beauty of the model is in its ability to absolve or abstract away details of parallelism, fault tolerance, synchronization, and input management from the user. A user typically writes her algorithm using two uniform functions — a map Read more…

How HPC is Hacking Hadoop

Feb 11, 2014 |

Although the trend may be quiet and distributed across only a relative few supercomputing sites, Hadoop and HPC are hopping hand-in-hand more frequently. These two technology areas aren’t necessarily made for another—there are limitations in what Hadoop can do. But a stretch of recent research has been pushing the possibilities, especially when it comes to Read more…

Cray Advances Hadoop for HPC

Feb 4, 2014 |

In a recent blog entry, Mike Boros, Hadoop Product Marketing Manager at Cray, Inc., writes about the company’s positioning of Hadoop for scientific big data. Like the old adage, “when the only tool you have is a hammer, every problem begins to resemble a nail,” Boros suggests that the Law of the Instrument may be true Read more…

SC13 Spotlights Three Main Trends

Dec 18, 2013 |

Collecting my thoughts after a thrilling and enlightening Supercomputing Conference in Denver, I want to discuss some of the key trends and highlights observed. The annual conference is always a hotbed of product announcements and this year, the 25th running, was no exception. There are many articles covering the key announcements, so I instead want Read more…

Sponsored Links