Cloud Computing: It’s Not Just for Rocket Scientists

By Jose Luis Vazquez-Poletti

December 5, 2011

The ability to run HPC workloads inside a public or private cloud provides valuable insights related to both the industrial and academic worlds. If you focus on the latter and on universities in particular, you will see that we professors do not spend our entire day on research exclusively, as teaching is among our duties. This article explains how cloud computing can also be accessed by students in order to complement their education by developing Master Thesis projects related to this technology. What follows is a showcasing of the splendid work done by my students recently.

Every academic year, computer science students file in to their professors’ offices to inquire about proposed Master Thesis projects. When students come to me, I respond with another question: “What would you like to work on that may benefit from cloud computing?”

If motivating Master Thesis students by having their work be an extension of their natural interests is a must, involving them in a bleeding-edge technology like cloud computing is the icing on the cake.

As I allude to in the title of this article, one of the features of this technology is its high accessibility. In this way, it opens up a world of research possibilities and engenders a fast learning process, allowing the students to develop in a reasonable time projects like the ones that are outlined below:

RSA@Cloud: Efficient Cryptanalysis on the Cloud (2010-2011)

When I asked these three students about a research field that would benefit from cloud-based cycles, they answered “cryptanalysis” as they understood that public cloud providers would provide the best infrastructure for an efficient security auditing of RSA keys (used in many fields, such as e-commerce) in terms of performance and cost.

RSA@Cloud: Alberto Megia, Antonio Molinera and Jose Antonio Rueda at one of the UCM classrooms.

They developed a system that took advantage of parallel programming and cloud computing in order to factorize very big integers, the real basis of RSA cryptosystem’s security, by executing different mathematic algorithms like trial division and quadratic sieve. The combination of Amazon EC2 and private cloud machines were chosen to achieve this goal, since both make possible to reach the efficient results mentioned above.

The RSA@Cloud system relies in three main modules:

  • The Forecaster, a simulation software whose purpose is to estimate the required processing time and cost on Amazon EC2 allowing to find a compromise between these two parameters.

  • The Engine, the RSA keys factorization and parallelization module. New factorization algorithms can be easily added as they only need a wrapper script for their integration in the system.

  • The Keyswarm, a graphic representation of the interactions between cloud machines during the process. It uses Code Swarm (http://code.google.com/p/codeswarm/) by translating RSA@Cloud events to CVS/SVN ones.


RSA@Cloud: Forecaster module.

An interesting outcome of this Master Thesis project was the preparation and presentation of a research paper at a Spanish conference by my students. This experience allowed them to get in touch with the national scientific landscape but also with the nice natural landscape of Tenerife (Canary Islands), where the conference took place. All in all, this trip was a fitting reward for a job well-done.


RSA@Cloud: Keyswarm module showing factorization of a 49 digit RSA key using 12 machines. Each parallel task is represented by a dot.

CONSTRUCTOR: Cloud PaaS for Startups (2011-2012, ongoing)

These students planned to orient their professional career to the industry once they leave the university. With this in mind, they researched how a software startup could begin its activity and continue to prosper.


CONSTRUCTOR: Isabel Espinar, Adrian Escoms and Esther Rodrigo with a “tuned” set of servers from the UCM Computer Science Museum.

They understood that a startup with a low budget could rely solely on on-demand resources provided by a public cloud infrastructure. A development phase of a given product has specific software requirements that can be restrictive, so the developers need a tool to easily deploy and (re)configure the necessary machines. Also, developers need a standard entry point to the development platform, allowing them to change the context as fast as possible. On the other hand, the startup needs to calculate the exact development cost in order to assign a competitive price to the final product.

With these previous factors taken into account, my students’ framework, named CONSTRUCTOR as a reference to “The Matrix” saga, will provide a graphical user interface with the following features:

  • Virtual machine management using Amazon EC2 API.

  • Software deployment using Chef (http://www.opscode.com/chef/).

  • Instant generation of a Eclipse (http://www.eclipse.org/) configuration file corresponding to the virtual machine and software that the developer wants to work with.

  • Differentiated accounting (virtual machine usage) for each development phase and software product.


CONSTRUCTOR’s key features.

POPULOUS: Biodiversity on the Cloud (2011-2012, ongoing)

Only one member comprises the team behind this project, as he was my student at the UCM Master in Bioinformatics and Computational Biology (http://bbm1.ucm.es/masterbioinfo/) and not at the Faculty’s Computer Science studies. He is currently preparing his Master Thesis at a department in the Spanish Natural Sciences National Museum (http://www.mncn.csic.es/).


POPULOUS: Gonzalo Santana and one of the National Natural Sciences Museum exhibits, a Snow Leopard.

His project, named POPULOUS as a reference to the 1989 video game, aims to understand the effects of climatic elements on the evolution, migration and extinction of species and biodiversity. This is accomplished with complex mathematical models that generate physiologic responses from the studied species according to climatic data. Survival odds for each species are then obtained for a given area.

The resulting system will verify if biodiversity in mountains is higher than in other zones or if the climatic change forces species to migrate to other zones where their survival odds are higher.

The initial computational resources available at my student’s department consisted in a NVIDIA GPU cluster with no dedicated usage. The final application will be very computing intensive and should not discard any available resources in order to increase global performance. For this reason, my student turned his attention to public cloud infrastructures that would complement the local resources.

Focusing on a lower level, the parallel application will be executed in both CPU and GPU resources provided by local and cloud infrastructures. For this reason, my student has chosen the OpenCL API (http://www.khronos.org/opencl/).

The next generation of “cloud shapers”

Cloud computing is a reality we are using on a daily basis, but now it’s time to start considering the next generation that will fill our ranks.

Master Thesis projects are a great opportunity assisted by the many applications of cloud computing and boosted by the student’s imagination. If cloud’s high accessibility and open source tools are added to the equation then we get the best methodology to help them implement their awesome ideas.

As I say to my students year after year: “It’s not only education but ideas that will help you survive outside this classroom.”

About the Author

Dr. Jose Luis Vazquez-PolettiDr. Jose Luis Vazquez-Poletti is Assistant Professor in Computer Architecture at Complutense University of Madrid (UCM, Spain), and a Cloud Computing Researcher at the Distributed Systems Architecture Research Group. He is (and has been) directly involved in EU-funded projects, such as EGEE (Grid Computing) and 4CaaSt (PaaS Cloud), as well as many Spanish national initiatives.

From 2005 to 2009, Professor Vazquez-Poletti’s research focused in application porting onto Grid Computing infrastructures, activity that let him be “where the real action was.” These applications pertained to a wide range of areas, from Fusion Physics to Bioinformatics. During this period he achieved the abilities needed for profiling applications and making them benefit of distributed computing infrastructures. Additionally, he shared these abilities in many training events organized within the EGEE Project and similar initiatives.

Since 2010 his research interests lie in different aspects of cloud computing, but always having real life applications in mind, specially those pertaining to the High Performance Computing domain.

Website: http://dsa-research.org/jlvazquez/

Linkedin: http://es.linkedin.com/in/jlvazquezpoletti/

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

DARPA Continues Investment in Post-Moore’s Technologies

July 24, 2017

The U.S. military long ago ceded dominance in electronics innovation to Silicon Valley, the DoD-backed powerhouse that has driven microelectronic generation for decades. With Moore's Law clearly running out of steam, the Read more…

By George Leopold

Graphcore Readies Launch of 16nm Colossus-IPU Chip

July 20, 2017

A second $30 million funding round for U.K. AI chip developer Graphcore sets up the company to go to market with its “intelligent processing unit” (IPU) in 2017 with scale-up production for enterprise datacenters and Read more…

By Tiffany Trader

Fine-Tuning Severe Hail Forecasting with Machine Learning

July 20, 2017

Depending on whether you’ve been caught outside during a severe hail storm, the sight of greenish tinted clouds on the horizon may cause serious knots in the pit of your stomach, or at least give you pause. There’s g Read more…

By Sean Thielen

Trinity Supercomputer’s Haswell and KNL Partitions Are Merged

July 19, 2017

Trinity supercomputer’s two partitions – one based on Intel Xeon Haswell processors and the other on Xeon Phi Knights Landing – have been fully integrated are now available for use on classified work in the Nationa Read more…

By HPCwire Staff

HPE Extreme Performance Solutions

HPE Servers Deliver High Performance Remote Visualization

Whether generating seismic simulations, locating new productive oil reservoirs, or constructing complex models of the earth’s subsurface, energy, oil, and gas (EO&G) is a highly data-driven industry. Read more…

Fujitsu Continues HPC, AI Push

July 19, 2017

Summer is well under way, but the so-called summertime slowdown, linked with hot temperatures and longer vacations, does not seem to have impacted Fujitsu's output. The Japanese multinational has made a raft of HPC and A Read more…

By Tiffany Trader

Researchers Use DNA to Store and Retrieve Digital Movie

July 18, 2017

From abacus to pencil and paper to semiconductor chips, the technology of computing has always been an ever-changing target. The human brain is probably the computer we use most (hopefully) and understand least. This mon Read more…

By John Russell

The Exascale FY18 Budget – The Next Step

July 17, 2017

On July 12, 2017, the U.S. federal budget for its Exascale Computing Initiative (ECI) took its next step forward. On that day, the full Appropriations Committee of the House of Representatives voted to accept the recomme Read more…

By Alex R. Larzelere

Summer Reading: IEEE Spectrum’s Chip Hall of Fame

July 17, 2017

Take a trip down memory lane – the Mostek MK4096 4-kilobit DRAM, for instance. Perhaps processors are more to your liking. Remember the Sh-Boom processor (1988), created by Russell Fish and Chuck Moore, and named after Read more…

By John Russell

Graphcore Readies Launch of 16nm Colossus-IPU Chip

July 20, 2017

A second $30 million funding round for U.K. AI chip developer Graphcore sets up the company to go to market with its “intelligent processing unit” (IPU) in Read more…

By Tiffany Trader

Fine-Tuning Severe Hail Forecasting with Machine Learning

July 20, 2017

Depending on whether you’ve been caught outside during a severe hail storm, the sight of greenish tinted clouds on the horizon may cause serious knots in the Read more…

By Sean Thielen

Fujitsu Continues HPC, AI Push

July 19, 2017

Summer is well under way, but the so-called summertime slowdown, linked with hot temperatures and longer vacations, does not seem to have impacted Fujitsu's out Read more…

By Tiffany Trader

Researchers Use DNA to Store and Retrieve Digital Movie

July 18, 2017

From abacus to pencil and paper to semiconductor chips, the technology of computing has always been an ever-changing target. The human brain is probably the com Read more…

By John Russell

The Exascale FY18 Budget – The Next Step

July 17, 2017

On July 12, 2017, the U.S. federal budget for its Exascale Computing Initiative (ECI) took its next step forward. On that day, the full Appropriations Committee Read more…

By Alex R. Larzelere

Women in HPC Luncheon Shines Light on Female-Friendly Hiring Practices

July 13, 2017

The second annual Women in HPC luncheon was held on June 20, 2017, during the International Supercomputing Conference in Frankfurt, Germany. The luncheon provid Read more…

By Tiffany Trader

Satellite Advances, NSF Computation Power Rapid Mapping of Earth’s Surface

July 13, 2017

New satellite technologies have completely changed the game in mapping and geographical data gathering, reducing costs and placing a new emphasis on time series Read more…

By Ken Chiacchia and Tiffany Jolley

Intel Skylake: Xeon Goes from Chip to Platform

July 13, 2017

With yesterday’s New York unveiling of the new “Skylake” Xeon Scalable processors, Intel made multiple runs at multiple competitive threats and strategic Read more…

By Doug Black

Google Pulls Back the Covers on Its First Machine Learning Chip

April 6, 2017

This week Google released a report detailing the design and performance characteristics of the Tensor Processing Unit (TPU), its custom ASIC for the inference Read more…

By Tiffany Trader

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Quantum Bits: D-Wave and VW; Google Quantum Lab; IBM Expands Access

March 21, 2017

For a technology that’s usually characterized as far off and in a distant galaxy, quantum computing has been steadily picking up steam. Just how close real-wo Read more…

By John Russell

HPC Compiler Company PathScale Seeks Life Raft

March 23, 2017

HPCwire has learned that HPC compiler company PathScale has fallen on difficult times and is asking the community for help or actively seeking a buyer for its a Read more…

By Tiffany Trader

Trump Budget Targets NIH, DOE, and EPA; No Mention of NSF

March 16, 2017

President Trump’s proposed U.S. fiscal 2018 budget issued today sharply cuts science spending while bolstering military spending as he promised during the cam Read more…

By John Russell

CPU-based Visualization Positions for Exascale Supercomputing

March 16, 2017

In this contributed perspective piece, Intel’s Jim Jeffers makes the case that CPU-based visualization is now widely adopted and as such is no longer a contrarian view, but is rather an exascale requirement. Read more…

By Jim Jeffers, Principal Engineer and Engineering Leader, Intel

Nvidia’s Mammoth Volta GPU Aims High for AI, HPC

May 10, 2017

At Nvidia's GPU Technology Conference (GTC17) in San Jose, Calif., this morning, CEO Jensen Huang announced the company's much-anticipated Volta architecture a Read more…

By Tiffany Trader

Facebook Open Sources Caffe2; Nvidia, Intel Rush to Optimize

April 18, 2017

From its F8 developer conference in San Jose, Calif., today, Facebook announced Caffe2, a new open-source, cross-platform framework for deep learning. Caffe2 is the successor to Caffe, the deep learning framework developed by Berkeley AI Research and community contributors. Read more…

By Tiffany Trader

Leading Solution Providers

How ‘Knights Mill’ Gets Its Deep Learning Flops

June 22, 2017

Intel, the subject of much speculation regarding the delayed, rewritten or potentially canceled “Aurora” contract (the Argonne Lab part of the CORAL “ Read more…

By Tiffany Trader

Reinders: “AVX-512 May Be a Hidden Gem” in Intel Xeon Scalable Processors

June 29, 2017

Imagine if we could use vector processing on something other than just floating point problems.  Today, GPUs and CPUs work tirelessly to accelerate algorithms Read more…

By James Reinders

MIT Mathematician Spins Up 220,000-Core Google Compute Cluster

April 21, 2017

On Thursday, Google announced that MIT math professor and computational number theorist Andrew V. Sutherland had set a record for the largest Google Compute Engine (GCE) job. Sutherland ran the massive mathematics workload on 220,000 GCE cores using preemptible virtual machine instances. Read more…

By Tiffany Trader

Russian Researchers Claim First Quantum-Safe Blockchain

May 25, 2017

The Russian Quantum Center today announced it has overcome the threat of quantum cryptography by creating the first quantum-safe blockchain, securing cryptocurrencies like Bitcoin, along with classified government communications and other sensitive digital transfers. Read more…

By Doug Black

Google Debuts TPU v2 and will Add to Google Cloud

May 25, 2017

Not long after stirring attention in the deep learning/AI community by revealing the details of its Tensor Processing Unit (TPU), Google last week announced the Read more…

By John Russell

Groq This: New AI Chips to Give GPUs a Run for Deep Learning Money

April 24, 2017

CPUs and GPUs, move over. Thanks to recent revelations surrounding Google’s new Tensor Processing Unit (TPU), the computing world appears to be on the cusp of Read more…

By Alex Woodie

Top500 Results: Latest List Trends and What’s in Store

June 19, 2017

Greetings from Frankfurt and the 2017 International Supercomputing Conference where the latest Top500 list has just been revealed. Although there were no major Read more…

By Tiffany Trader

Six Exascale PathForward Vendors Selected; DoE Providing $258M

June 15, 2017

The much-anticipated PathForward awards for hardware R&D in support of the Exascale Computing Project were announced today with six vendors selected – AMD Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Share This