Cray Advances Hadoop for HPC

February 4, 2014

In a recent blog entry, Mike Boros, Hadoop Product Marketing Manager at Cray, Inc., writes about the company's positioning of Hadoop for scientific big data. Li Read more…

By Tiffany Trader

Accelerate Hadoop MapReduce Performance using Dedicated OrangeFS Servers

September 9, 2013

Recent tests performed at Clemson University achieved a 25 percent improvement in Apache Hadoop Terasort run times by replacing Hadoop Distributed File System (HDFS) with an OrangeFS configuration using dedicated servers. Key components included extension of the MapReduce “FileSystem” class and a Java Native Interface (JNI) shim to the OrangeFS client. No modifications of Hadoop were required, and existing MapReduce jobs require no modification to utilize OrangeFS. Read more…

By Nicole Hemsoth

Why Big Data Needs InfiniBand to Continue Evolving

April 1, 2013

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href="http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/" target="_blank">a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out...) Read more…

By Nicole Hemsoth

Why Big Data Needs InfiniBand to Continue Evolving

April 1, 2013

Increasingly, it’s a Big Data world we live in. Just in case you’ve been living under a rock and need proof of that, <a href="http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/" target="_blank">a major retailer can use an unimaginable number of data points to predict the pregnancy of a teenage girl outside Minneapolis before she gets a chance to tell her family</a>.  That’s just one example, but there are countless others that point to the idea that mining huge data volumes can uncover gold nuggets of actionable proportions (although sometimes they freak people out...) Read more…

By Nicole Hemsoth

New OpenSFS Rep on the Future of Lustre

March 12, 2013

OpenSFS has chosen its Community Representative Director for 2013: Tommy Minyard, director of Advanced Computing Systems (ACS) at the Texas Advanced Computing Center (TACC). We got the new director's views on Lustre's opportunities in big data and exascale, maintaining a single source tree, and new features on the horizon. Read more…

By Richard L. Brandt

Free Lectures: Cloud, Virtualization, MapReduce and More

January 7, 2013

Several lectures from the VSCSE Summer School on Science Clouds are now available for viewing on YouTube. Read more…

By Tiffany Trader

Cloud Browser Hack Exposed

December 3, 2012

Researchers from North Carolina State University and the University of Oregon show how hackers can anonymously hijack computing power from cloud-based Web browsers. Read more…

By Tiffany Trader

Microsoft Brings MapReduce into the Fold

July 18, 2011

Microsoft announced this week that it would be offering its Project Daytona up for scrutiny--an iterative MapReduce framework that they hope will bring researchers flocking to their cloud service. Read more…

By Nicole Hemsoth

  • arrow
  • Click Here for More Headlines
  • arrow

Leading Solution Providers

Whitepaper:

Strategies for the Spectrum of Cloud Adoptions

Whether an organization chooses a cloud for general business needs or a highly tailored workload, the spectrum of offerings and configurations can be overwhelming. To help you navigate the various cloud options available today, we're breaking down your options, exploring pros and cons, and sharing ways to keep your options open and your business agile as you execute your cloud strategy.

Download this report

Sponsored by Microsoft

Whitepaper:

Adaptive Flexibility is the Future of Supercomputing – The Arm advantage for HPC workloads

Researchers in academic labs and commercial R&D groups continue to need more compute capacity, which means leveraging the latest innovations in HPC technologies as well as an assortment of resources to meet the unique needs of different workloads. Increasingly, systems based on Arm processors are stepping into that role, offering low power consumption and strategic advantages for HPC workloads.

Download this report

Sponsored by Cray

Whitepaper:

HPC Goes Mainstream

Whether it's for fraud detection, personalized medicine, manufacturing, smart cities, autonomous vehicles and many other areas, advanced-scale computing has exploded beyond the realm of academia and government and into the private sector. And with data-intensive workloads on the rise, commercial users are turning to HPC-based infrastructure to run the AI, ML and cognitive computing applications that their organizations depend on.

Download this report

Sponsored by SUSE

Advanced Scale Career Development & Workforce Enhancement Center

Featured Advanced Scale Jobs:

Receive the Monthly
Advanced Computing Job Bank Resource:

HPCwire Resource Library

HPCwire Product Showcase

Subscribe to the Monthly
Technology Product Showcase:

Subscribe