Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them

Language Flags
August 7, 2012

Curiosity’s Cloud Connection

Robert Gelber

The news media has been abuzz over NASA’s recent achievement. The big risk, big reward operation costing 2.5 billion dollars, which included safely landing a mini cooper-sized robot on Mars, paid off. Behind the scenes, the agency has relied on cloud services to keep people informed and will most likely continue to use similar application to assist the rover as it explores the red planet.

NASA Curious Link
Animation of the Mars rover Curiosity communicating

Just before the landing took place, GigaOm posted an article detailing the preparations NASA put into their live stream. The agency knew Curiosity’s entry sequence was going to be a big event, so they had to prepare for high amounts of Web traffic aimed at their live stream.

They partnered with SOASTA, a service that tests how much load applications can handle on the web. The company uses cloud resources to flood servers, emulating high amounts of traffic. It’s a method of testing the stamina of a given infrastructure and was used to determine the resiliency of the 2012 Olympic website.

In NASA’s case, a Mac Pro at the Jet Propulsion Laboratory (JPL) shipped four streams of various bitrates to a flash server. The flash server then pushed the streams to a “tier 1″ server, which was replicated by 40 load balanced “tier 2″ servers on Amazon’s EC2.

When SOASTA tested the stream, they generated 25 Gbps of traffic for 40 minutes. In addition, they terminated 10 instances and then 20 instances from NASA’s stream to make sure Amazon’s load balancing service would automatically bring them back up. During the 40-minute test, SOASTA downloaded over 6 terabytes of data. Needless to say, NASA’s stream worked without a hitch.

Looking ahead, it appears the agency will continue to use cloud applications during the Curiosity’s mission. HPC in the Cloud reported on NASA’s use of Windows Azure to power a new cloud-based application called the “Be a Martian” program. The project uploaded 250,000 images of Mars onto Microsoft’s cloud platform and served more than 2.5 million data queries. Given that the new rover is equipped with 17 onboard cameras, there is a good chance a number of images captured by Curiosity will make their way to the application.

SC14 Virtual Booth Tours

AMD SC14 video AMD Virtual Booth Tour @ SC14
Click to Play Video
Cray SC14 video Cray Virtual Booth Tour @ SC14
Click to Play Video
Datasite SC14 video DataSite and RedLine @ SC14
Click to Play Video
HP SC14 video HP Virtual Booth Tour @ SC14
Click to Play Video
IBM DCS3860 and Elastic Storage @ SC14 video IBM DCS3860 and Elastic Storage @ SC14
Click to Play Video
IBM Flash Storage
@ SC14 video IBM Flash Storage @ SC14  
Click to Play Video
IBM Platform @ SC14 video IBM Platform @ SC14
Click to Play Video
IBM Power Big Data SC14 video IBM Power Big Data @ SC14
Click to Play Video
Intel SC14 video Intel Virtual Booth Tour @ SC14
Click to Play Video
Lenovo SC14 video Lenovo Virtual Booth Tour @ SC14
Click to Play Video
Mellanox SC14 video Mellanox Virtual Booth Tour @ SC14
Click to Play Video
Panasas SC14 video Panasas Virtual Booth Tour @ SC14
Click to Play Video
Quanta SC14 video Quanta Virtual Booth Tour @ SC14
Click to Play Video
Seagate SC14 video Seagate Virtual Booth Tour @ SC14
Click to Play Video
Supermicro SC14 video Supermicro Virtual Booth Tour @ SC14
Click to Play Video