Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags

Tag: MapReduce

Cray Advances Hadoop for HPC

Feb 4, 2014 |

In a recent blog entry, Mike Boros, Hadoop Product Marketing Manager at Cray, Inc., writes about the company’s positioning of Hadoop for scientific big data. Like the old adage, “when the only tool you have is a hammer, every problem begins to resemble a nail,” Boros suggests that the Law of the Instrument may be true Read more…

Accelerate Hadoop MapReduce Performance using Dedicated OrangeFS Servers

Sep 9, 2013 |

Recent tests performed at Clemson University achieved a 25 percent improvement in Apache Hadoop Terasort run times by replacing Hadoop Distributed File System (HDFS) with an OrangeFS configuration using dedicated servers. Key components included extension of the MapReduce “FileSystem” class and a Java Native Interface (JNI) shim to the OrangeFS client. No modifications of Hadoop were required, and existing MapReduce jobs require no modification to utilize OrangeFS.

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

Why Big Data Needs InfiniBand to Continue Evolving

Apr 1, 2013 |

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href=”http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/” target=”_blank”>a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out…)

New OpenSFS Rep on the Future of Lustre

Mar 12, 2013 |

<img style=”float: left;” src=”http://media2.hpcwire.com/hpcwire/OpenSFS_logoCROPPED.jpg” alt=”” width=”95″ height=”51″ />OpenSFS has chosen its Community Representative Director for 2013: Tommy Minyard, director of Advanced Computing Systems (ACS) at the Texas Advanced Computing Center (TACC). We got the new director’s views on Lustre’s opportunities in big data and exascale, maintaining a single source tree, and new features on the horizon.

Free Lectures: Cloud, Virtualization, MapReduce and More

Jan 7, 2013 |

Several lectures from the VSCSE Summer School on Science Clouds are now available for viewing on YouTube.

Cloud Browser Hack Exposed

Dec 3, 2012 |

Researchers from North Carolina State University and the University of Oregon show how hackers can anonymously hijack computing power from cloud-based Web browsers.

Microsoft Brings MapReduce into the Fold

Jul 18, 2011 |

Microsoft announced this week that it would be offering its Project Daytona up for scrutiny–an iterative MapReduce framework that they hope will bring researchers flocking to their cloud service.

Platform Tunes Symphony for Big Data Deluge

Mar 31, 2011 |

Culling together massive data has provided some profound opportunities for a wide array of analytics projects but has created a number of complications for those who want to gain actionable intelligence from it. While the “big data” movement is still unfolding, a number of companies have emerged to help simplify access and use, especially of unstructured information. HPC stalwart Platform Computing entered the race to refine handling of vast datasets — not to mention the management behind such operations to stake their claim in this emerging space.

The Weekly Top Five

Mar 31, 2011 |

The Weekly Top Five features the five biggest HPC stories of the week, condensed for your reading pleasure. This week, we cover the UK-based Atomic Weapons Establishment’s selection of two SGI Altix systems; Platform Computing’s new solution for managing “big data”; the effect of rising sea levels on the North Carolina coastal region; SDSC’s new portal for conducting phylogenetic research; and the selection of Ian Foster for this year’s IEEE Tsutomu Kanai Award.