Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags

Tag: big data

IBM Applies Elastic Storage to Big Data Challenge

Aug 25, 2014 |

A big data tool developed by IBM in partnership with Deutsches Elektronen-Synchrotron (DESY) will enable scientists around the world to more quickly manage and share massive volumes of x-ray data produced by a super microscope in Germany. German research center DESY develops, builds and operates large particle accelerators used to investigate the structure of matter. Read more…

NSF Rolls Out Innovative Cloud Testbeds

Aug 21, 2014 |

The National Science Foundation (NSF) announced funding for two cloud testbeds, named “Chameleon” and “CloudLab.” A total award of $20 million to be split evenly between the projects will enable the academic research community to create and experiment with novel cloud architectures and potentially transformative applications. Along with developing next-generation cloud systems, the programs emphasize the Read more…

Tackling Big Data Storage Problems with Site-Wide Storage

May 19, 2014 |

When it comes to storage problems, no one is exempt. The exponential growth of scientific and technical big data is not only having a major impact on HPC storage infrastructures at the world’s largest organizations, but at small-to medium-sized companies as well. The stumbling blocks at large organizations are highly visible. Over the years the Read more…

The Next Big Data Challenge: Data Paring

May 12, 2014 |

Guest Editorial I think a lot about big data and the challenges it proposes. I guess I started thinking about big data a long time before I ever heard the term. I began to think about it when I heard and read one of the conclusions of the post-mortem for the events on and around Read more…

Dynamic Disk Pools Optimize Data Protection for Big Data Environments

May 12, 2014 |

In high-performance computing (HPC) and other big-data environments, success depends on the speed at which data is acquired, processed, and distributed. These environments use staggering amounts of data that can cripple most storage systems and break traditional architectures. For these sites, the ability to keep a system up and running at a consistently high level Read more…

Prioritizing Data in the Age of Exascale

Apr 14, 2014 |

By now, most HPCers and the surrounding community are aware that data movement poses one of the most fundamental challenges to post-petascale computing. Around the world exascale-directed projects are attempting to maximize system speeds while minimizing energy costs. In the US, for example, exascale targets have peak performance increasing by three orders of magnitude while Read more…

DOE Exascale Roadmap Highlights Big Data

Apr 7, 2014 |

If you’ve been following the US exascale roadmap, then chances are you’ve been following the work of William (“Bill”) J. Harrod, Division Director for the Advanced Scientific Computing Research (ASCR), Office of Science with the US Department of Energy (DOE). In January, Harrod asserted that the DOE’s mission to push the frontiers of science and Read more…

How NASA Is Meeting the Big Data Challenge

Apr 7, 2014 |

As the scientific community pushes past petaflop into exascale territory, it is imperative that the tools to support ever-more data-intensive workloads keep pace. No where is this more true than at the storied NASA research complex. With 100 active missions supporting cutting-edge science, NASA knows more than most about compute- and data-driven challenges. A recent paper Read more…

Big Data Reaches to the Stratosphere

Apr 3, 2014 |

Among the many compelling papers to come out of the Big Data and Extreme-scale Computing (BDEC) workshop, held in Fukuoka, Japan, in February, was a position paper from Dr. Volker Markl, full professor and chair of the Database Systems and Information Management (DIMA) group at the Technische Universität Berlin (TU Berlin) detailing the benefits of Read more…

Instrument Science Preps for Exascale Era

Apr 3, 2014 |

The Big Data and Extreme-scale Computing (BDEC) workshop that took place in February in Fukuoka, Japan, brought together luminaries from industry, academia and government to discuss today’s big data challenges in the context of extreme-scale computing. Attendees to this invitation-only event include some of the world’s foremost experts on algorithms, computer system architecture, operating systems, Read more…