Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags

Tag: Hadoop

Hacking into the N-Queens Problem with Virtualization

Jun 19, 2013 |

Ruan Pethiyagoda, Cameron Boehmer, John S. Dvorak, and Tim Sze, trained at San Francisco’s Hack Reactor, an institute designed for intense fast paced learning of programming, put together a program based on the N-Queens algorithm designed by the University of Cambridge’s Martin Richards, and modified it to run in parallel across multiple machines.

TACC Longhorn Takes On Natural Language Processing

Jun 14, 2013 |

For all the progress we’ve made in IT over the last 50 years, there’s one area of life that has steadfastly eluded the grasp of computers: understanding human language. Now, researchers at the Texas Advanced Computing Center (TACC) are utilizing a Hadoop cluster on its Longhorn supercomputer to move the state of the art of language processing a little bit further.

Intel Carves Mainstream Highway for Lustre

Jun 12, 2013 |

Today Intel announced some new pitches to push Lustre in front of enterprise eyeballs with usability features for Lustre and a total rip and replace for the native Hadoop file system designed to appeal to the HPC-oriented Hadoop set. We talked with Brent Gorda, former CEO and founder of Whamcloud, which Intel acquired just a tick under a year ago about how….

TACC’s Hadoop Cluster Breaks New Ground

May 30, 2013 |

A 256-node Hadoop system at the University of Texas at Austin is breaking down the barriers that have traditionally kept high performance computing relegated to technical experts. Nearly 70 students and researchers at TACC have used the cluster to crunch big datasets, and provide potential answers to questions in the fields of biomedicine, linguistics, and astronomy.

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

New OpenSFS Rep on the Future of Lustre

Mar 12, 2013 |

<img style=”float: left;” src=”http://media2.hpcwire.com/hpcwire/OpenSFS_logoCROPPED.jpg” alt=”” width=”95″ height=”51″ />OpenSFS has chosen its Community Representative Director for 2013: Tommy Minyard, director of Advanced Computing Systems (ACS) at the Texas Advanced Computing Center (TACC). We got the new director’s views on Lustre’s opportunities in big data and exascale, maintaining a single source tree, and new features on the horizon.

Five Ways Univa Saves You Money

Mar 4, 2013 |

We have identified five key ways that Univa creates business value for our customers for a modest investment. By upgrading Grid Engine an organization can reduce downtime, boost its jobs per day throughput and find ways to manage application license costs to help meet the budget cut requirements in capital spending imposed by the reality of tough times.

Free Lectures: Cloud, Virtualization, MapReduce and More

Jan 7, 2013 |

Several lectures from the VSCSE Summer School on Science Clouds are now available for viewing on YouTube.

Using an In-Memory Data Grid for Near Real-Time Data Analysis

Aug 6, 2012 |

With the ever increasing explosion in data for analysis and the need for fast insights on emerging trends, in-memory data grids (IMDGs) offer a highly attractive platform for hosting map/reduce analysis. In comparison to disk-based map/reduce platforms such as Hadoop, IMDGs reduce analysis times by reducing data motion while simplifying the development model. For applications which need to analyze fast-changing application data, such as shopping or financial trading data, IMDGs can provide near real-time results.