With the ever increasing explosion in data for analysis and the need for fast insights on emerging trends, in-memory data grids (IMDGs) offer a highly attractive platform for hosting map/reduce analysis. In comparison to disk-based map/reduce platforms such as Hadoop, IMDGs reduce analysis times by reducing data motion while simplifying the development model. For applications which need to analyze fast-changing application data, such as shopping or financial trading data, IMDGs can provide near real-time results.
SGI, Microsoft warm up their Hadoop offerings.
Culling together massive data has provided some profound opportunities for a wide array of analytics projects but has created a number of complications for those who want to gain actionable intelligence from it. While the “big data” movement is still unfolding, a number of companies have emerged to help simplify access and use, especially of unstructured information. HPC stalwart Platform Computing entered the race to refine handling of vast datasets — not to mention the management behind such operations to stake their claim in this emerging space.
Another company has emerged from the woodwork to help bring the power of Hadoop to a hungry enterprise audience, this one focusing on refining the open source tool itself.
This week we checked in with experts from Microsoft, IBM, Yahoo, Facebook’s Hadoop engineering team and others to discuss some diverse issues related to big data, including changes in use, frameworks and applications. We also identify the year’s most profound trends and speculate on what lies ahead.
As the IBM Watson supercomputer prepares to battle human champions on Jeopardy, the Apache Software Foundation highlights the role of open source software keys to supercomputer trivia performance.
Vineet Tyagi of Impetus Technologies presented a session at Cloud Expo on Hadoop and Big Data Analytics, which covered issues relevant to the use of Hadoop in the enterprise and an introduction to the ecosystem that has emerged around it. In this video interview, he went beyond the session to discuss some important side issues–and let us know what has been, quite literally, lost in translation to many.
There’s Apache’s Hadoop, there’s Google’s MapReduce, and in case it slipped completely off your radar, there is also Microsoft’s solution called Dryad—something that has all but disappeared from conversations until news this week that it would be coming out of hiding and to a paralllel programmer near you.
A new, simplified language for programming in cloud environments called “Bloom” is set for release later this year. An interview with one of Bloom’s creators, Joseph Hellerstein of U.C. Berkeley, explains the practical elements.
Latest iteration of Sun Grid Engine able to tap into Cloud.