Tag: Hadoop

TACC’s Hadoop Cluster Breaks New Ground

May 30, 2013 |

A 256-node Hadoop system at the University of Texas at Austin is breaking down the barriers that have traditionally kept high performance computing relegated to technical experts. Nearly 70 students and researchers at TACC have used the cluster to crunch big datasets, and provide potential answers to questions in the fields of biomedicine, linguistics, and astronomy.

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

New OpenSFS Rep on the Future of Lustre

Mar 12, 2013 |

<img style=”float: left;” src=”http://media2.hpcwire.com/hpcwire/OpenSFS_logoCROPPED.jpg” alt=”” width=”95″ height=”51″ />OpenSFS has chosen its Community Representative Director for 2013: Tommy Minyard, director of Advanced Computing Systems (ACS) at the Texas Advanced Computing Center (TACC). We got the new director’s views on Lustre’s opportunities in big data and exascale, maintaining a single source tree, and new features on the horizon.

Five Ways Univa Saves You Money

Mar 4, 2013 |

We have identified five key ways that Univa creates business value for our customers for a modest investment. By upgrading Grid Engine an organization can reduce downtime, boost its jobs per day throughput and find ways to manage application license costs to help meet the budget cut requirements in capital spending imposed by the reality of tough times.

Free Lectures: Cloud, Virtualization, MapReduce and More

Jan 7, 2013 |

Several lectures from the VSCSE Summer School on Science Clouds are now available for viewing on YouTube.

Using an In-Memory Data Grid for Near Real-Time Data Analysis

Aug 6, 2012 |

With the ever increasing explosion in data for analysis and the need for fast insights on emerging trends, in-memory data grids (IMDGs) offer a highly attractive platform for hosting map/reduce analysis. In comparison to disk-based map/reduce platforms such as Hadoop, IMDGs reduce analysis times by reducing data motion while simplifying the development model. For applications which need to analyze fast-changing application data, such as shopping or financial trading data, IMDGs can provide near real-time results.

HPC Players Embrace Hadoop

Oct 19, 2011 |

SGI, Microsoft warm up their Hadoop offerings.

Platform Tunes Symphony for Big Data Deluge

Mar 31, 2011 |

Culling together massive data has provided some profound opportunities for a wide array of analytics projects but has created a number of complications for those who want to gain actionable intelligence from it. While the “big data” movement is still unfolding, a number of companies have emerged to help simplify access and use, especially of unstructured information. HPC stalwart Platform Computing entered the race to refine handling of vast datasets — not to mention the management behind such operations to stake their claim in this emerging space.

Yale-Born Startup Sets Sights on Big Data Analytics

Mar 23, 2011 |

Another company has emerged from the woodwork to help bring the power of Hadoop to a hungry enterprise audience, this one focusing on refining the open source tool itself.