Microsoft’s Azure Chief Tallies, Evaluates Cloud User Patterns

By Nicole Hemsoth

June 7, 2010

Last week Microsoft announced that around 10,000 customers were using their relatively new Azure platform. The company’s general manager for Azure, Doug Hauger, was careful to address the fact that while that is the approximate tally of customers, many are running services for a large set of users, thus the number of users likely far surpasses this figure. Still, this is an impressive number for a platform that only went out of its year-long beta in February of this past year.

While this is still a far cry from the anticipated many millions of technical computing users that exist in the much-discussed missing middle of HPC who could be ushered in by the promise of its developer-friendly cloud, the news here does not reside in the numbers necessarily, but how they are translated into practical use.

What Microsoft is noticing about these 10,000 customers and their associated use patterns is worth noting for the sake of everyone from potential end users in the technical and enterprise computing space to ISVs to, quite frankly, anyone who wishes to compete for the same broad base of users. HPC and enterprise are converging and accordingly, what’s relevant news for one is equally so for the other as far as cloud platforms and application development challenges and successes are concerned.

Let the Revelations Begin

In an address at the Cowan and Company Technology, Media and Telecom Conference in New York last week, Hauger (Microsoft’s General Manager for Windows Azure) provided a critical breakdown of who their customers were, at least in the general sense, and how they seemed to be deploying its cloud offering. Predictably, end user details were somewhat vague in terms of application-specific details, but actually offered more in the way of end user adoption uses than other companies in the space are willing to divulge. The company was able to shed some light on the current state of cloud adoption models and general use patterns by providing these details, which actually makes it far easier to comprehend real cloud deployment outside of the rhetoric about adoption that is usually offered when companies with similar offerings discuss their cloud products.

The following is a description of what Microsoft has been noticing with Azure, which is categorized into five key use patterns: on-and-off batch job computing; resource gains for small start-up operations; predictable bursting; unpredictable bursting; and perhaps most surprising, steady state operations.

Azure for On and Off Batch Job Computing

To put this in appropriate context, Microsoft uses the example of risk analysis and management and the deployment of a Monte Carlo simulation on trading data. One unnamed company was previously running this exclusively on Windows Server High Performance Computing Edition and now instead of that exclusivity, it still runs on Windows sometimes but on occasion it is batched out to the Azure platform where they can then scale out to thousands of instances at a time for a sort of “burst” mode but only for this one specific application.

Startups and Azure

It’s always a pleasure when cloud vendors name names in the case of startups being enabled by the cloud, and Microsoft mentions French retail analytics company Lokad to highlight Azure’s capability for the small business that has the capacity to scale. This firm started off very small, not wishing to invest in its own datacenter, and has now grown exponentially, thus making the scalability coupled with the lack of up-front costs to invest in its own cluster a perfect scenario. This appears to be one of the key areas for cloud in general outside of what we think of as traditional HPC, especially as the volumes of data continue to mount.

Unpredictable and Predictable Bursting in Azure

Although Hauger lists these two separately, they have so much in common that coupling them together allows these two possible uses to play off one another rather nicely. In terms of unpredictable bursting and the advantage it grants, Microsoft cites Kelly Blue Book which is a vast database of prices that is dynamic in nature. During the U.S. Cash for Clunkers program, suddenly everyone wanted to check on the real-time value of new cars. The way the company structured its Azure platform was rather interesting because instead of handling the entire traffic flow in the cloud or only utilizing it for certain workloads, one in four visitors was directed to Azure and if demand increased dramatically, the potential to scale out their front end was granted seamlessly. This case highlights perfectly the strategy for many Web 2.0 businesses who are looking to the cloud to handle peak workflow and unexpected hikes in visitors or customers.

Conversely, some businesses are able to anticipate surges like Domino’s pizza, for instance. While yes, pizza is a bit of out of the scope for HPC the example — whether we’re talking about food delivery based on online ordering systems or engineering-related simulations delivered as a service during expected times of the year when demand is higher — this is all important. Having the ability to provision for known events like audits, for example is one of the more widely-discussed advantages to being able to scale out to a platform like Azure, among others.

The Big Surprise

Hauger says Microsoft estimates that close to half of all current usage of Azure is “steady run-rate usage, where companies are moving their applications onto the platform, and just having them run in steady state.” In other words, their customers are simply shutting down their on-site machinery and migrating to Azure, presumably to remain running something in steady state for the long haul.

What Early Analysis of Azure Use Indicates for HPC

In summarizing the use patterns for the first 10,000 customers (and who knows how many users) Hauger indicated that in his opinion adoption has been very good and surprising, “in that I expected the adoption at the lower-end with the startups and with sort of individual developers and small business ISVs as they get in to the VAS business. Where we’re also seeing adoption is at the high end where we’re seeing enterprise companies coming in and actually moving into cloud computing.” He attributes this surprising finding to the economic situation, especially as it existed at the launch of Azure suggesting that this force prompted enterprise to look carefully at the challenges, benefits and risks of a multitenant environment. With this powerful economic incentive they were more willing to look closer at what the regulatory and compliance environment was in practical context versus overlooking cloud alternatives out of fear and misinformation.

Why Emphasis on HPC and Azure is Critical to Microsoft

Hauger notes that in terms of the better-than-expected adoption at the high end, Microsoft is seeing Azure as a suitable place for HPC applications. “It’s actually net additive for Microsoft because we’re selling our highest end server SKU on premises and we’re able to leverage our economies of scale and we have the the benefits of us running this highly efficient platform out in the cloud. And so we get the benefit of both.”

One of the questions that naturally emerges is how to move existing workloads into this cloud, which is a particularly relevant one in the HPC space. Hauger waffles for a moment, giving the standard answer to this question for any cloud vendor—that the ease of transition is dependent on too many variables to address in generalities—but then does make a few succinct points, claiming that “if your application is a big, huge hairball and very expensive to run, it’s still going to be a big, huge hairball over here in this IaaS space and be difficult to run and expensive. And that’s where if your application is architected and then sort of specific to Azure, if you have a stateless well-architected service-oriented application that’s written in .NET on premises, moving that over to the Windows Azure platform is a simple thing.”

Well, okay…”if” is the key word here, but this is an expected barrier for cloud adoption more generally, which is why Microsoft does seem to be doing a decent job through its Visual Studio offerings, for example, of making these things a bit more palatable. In terms of this issue, Hauger states that despite some of these challenges, the advantage they have with their Azure offering is based distinctly on the developer community. “We’ve come at this as being truly committed to building a platform, a cloud platform, for developers. For Microsoft, I think, more than anything else, our DNA is developers. And we’ve built a platform that really addresses their needs, making their lives easier to get into the cloud computing space. And there very few, I would actually say probably no other companies out there, that have built a cloud platform that are truly developer companies.”

If Microsoft is looking to differentiate itself by the value it provides to the developer, it will be interesting to see how their competition steps up to the plate to address similar concerns. Without a doubt, the sticky issue of getting applications into the cloud — which may sound basic now that there’s already a platform for them to run on — seems like a top topic to tackle as we continue to evaluate how the cloud is being deployed in more application-specific contexts.

Note: The full webcast of the interview with Doug Hauger can be found here.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

IBM Launches Commercial Quantum Network with Samsung, ORNL

December 14, 2017

In the race to commercialize quantum computing, IBM is one of several companies leading the pack. Today, IBM announced it had signed JPMorgan Chase, Daimler AG, Samsung and a number of other corporations to its IBM Q Net Read more…

By Tiffany Trader

TACC Researchers Test AI Traffic Monitoring Tool in Austin

December 13, 2017

Traffic jams and mishaps are often painful and sometimes dangerous facts of life. At this week’s IEEE International Conference on Big Data being held in Boston, researchers from TACC and colleagues will present a new Read more…

By HPCwire Staff

AMD Wins Another: Baidu to Deploy EPYC on Single Socket Servers

December 13, 2017

When AMD introduced its EPYC chip line in June, the company said a portion of the line was specifically designed to re-invigorate a single socket segment in what has become an overwhelmingly two-socket landscape in the d Read more…

By John Russell

HPE Extreme Performance Solutions

Explore the Origins of Space with COSMOS and Memory-Driven Computing

From the formation of black holes to the origins of space, data is the key to unlocking the secrets of the early universe. Read more…

Microsoft Wants to Speed Quantum Development

December 12, 2017

Quantum computing continues to make headlines in what remains of 2017 as several tech giants jockey to establish a pole position in the race toward commercialization of quantum. This week, Microsoft took the next step in Read more…

By Tiffany Trader

IBM Launches Commercial Quantum Network with Samsung, ORNL

December 14, 2017

In the race to commercialize quantum computing, IBM is one of several companies leading the pack. Today, IBM announced it had signed JPMorgan Chase, Daimler AG, Read more…

By Tiffany Trader

AMD Wins Another: Baidu to Deploy EPYC on Single Socket Servers

December 13, 2017

When AMD introduced its EPYC chip line in June, the company said a portion of the line was specifically designed to re-invigorate a single socket segment in wha Read more…

By John Russell

Microsoft Wants to Speed Quantum Development

December 12, 2017

Quantum computing continues to make headlines in what remains of 2017 as several tech giants jockey to establish a pole position in the race toward commercializ Read more…

By Tiffany Trader

HPC Iron, Soft, Data, People – It Takes an Ecosystem!

December 11, 2017

Cutting edge advanced computing hardware (aka big iron) does not stand by itself. These computers are the pinnacle of a myriad of technologies that must be care Read more…

By Alex R. Larzelere

IBM Begins Power9 Rollout with Backing from DOE, Google

December 6, 2017

After over a year of buildup, IBM is unveiling its first Power9 system based on the same architecture as the Department of Energy CORAL supercomputers, Summit a Read more…

By Tiffany Trader

Microsoft Spins Cycle Computing into Core Azure Product

December 5, 2017

Last August, cloud giant Microsoft acquired HPC cloud orchestration pioneer Cycle Computing. Since then the focus has been on integrating Cycle’s organization Read more…

By John Russell

GlobalFoundries, Ayar Labs Team Up to Commercialize Optical I/O

December 4, 2017

GlobalFoundries (GF) and Ayar Labs, a startup focused on using light, instead of electricity, to transfer data between chips, today announced they've entered in Read more…

By Tiffany Trader

HPE In-Memory Platform Comes to COSMOS

November 30, 2017

Hewlett Packard Enterprise is on a mission to accelerate space research. In August, it sent the first commercial-off-the-shelf HPC system into space for testing Read more…

By Tiffany Trader

US Coalesces Plans for First Exascale Supercomputer: Aurora in 2021

September 27, 2017

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, in Arlington, Va., yesterday (Sept. 26), it was revealed that the "Aurora" supercompute Read more…

By Tiffany Trader

NERSC Scales Scientific Deep Learning to 15 Petaflops

August 28, 2017

A collaborative effort between Intel, NERSC and Stanford has delivered the first 15-petaflops deep learning software running on HPC platforms and is, according Read more…

By Rob Farber

Oracle Layoffs Reportedly Hit SPARC and Solaris Hard

September 7, 2017

Oracle’s latest layoffs have many wondering if this is the end of the line for the SPARC processor and Solaris OS development. As reported by multiple sources Read more…

By John Russell

AMD Showcases Growing Portfolio of EPYC and Radeon-based Systems at SC17

November 13, 2017

AMD’s charge back into HPC and the datacenter is on full display at SC17. Having launched the EPYC processor line in June along with its MI25 GPU the focus he Read more…

By John Russell

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Japan Unveils Quantum Neural Network

November 22, 2017

The U.S. and China are leading the race toward productive quantum computing, but it's early enough that ultimate leadership is still something of an open questi Read more…

By Tiffany Trader

GlobalFoundries Puts Wind in AMD’s Sails with 12nm FinFET

September 24, 2017

From its annual tech conference last week (Sept. 20), where GlobalFoundries welcomed more than 600 semiconductor professionals (reaching the Santa Clara venue Read more…

By Tiffany Trader

Amazon Debuts New AMD-based GPU Instances for Graphics Acceleration

September 12, 2017

Last week Amazon Web Services (AWS) streaming service, AppStream 2.0, introduced a new GPU instance called Graphics Design intended to accelerate graphics. The Read more…

By John Russell

Leading Solution Providers

IBM Begins Power9 Rollout with Backing from DOE, Google

December 6, 2017

After over a year of buildup, IBM is unveiling its first Power9 system based on the same architecture as the Department of Energy CORAL supercomputers, Summit a Read more…

By Tiffany Trader

Perspective: What Really Happened at SC17?

November 22, 2017

SC is over. Now comes the myriad of follow-ups. Inboxes are filled with templated emails from vendors and other exhibitors hoping to win a place in the post-SC thinking of booth visitors. Attendees of tutorials, workshops and other technical sessions will be inundated with requests for feedback. Read more…

By Andrew Jones

EU Funds 20 Million Euro ARM+FPGA Exascale Project

September 7, 2017

At the Barcelona Supercomputer Centre on Wednesday (Sept. 6), 16 partners gathered to launch the EuroEXA project, which invests €20 million over three-and-a-half years into exascale-focused research and development. Led by the Horizon 2020 program, EuroEXA picks up the banner of a triad of partner projects — ExaNeSt, EcoScale and ExaNoDe — building on their work... Read more…

By Tiffany Trader

Tensors Come of Age: Why the AI Revolution Will Help HPC

November 13, 2017

Thirty years ago, parallel computing was coming of age. A bitter battle began between stalwart vector computing supporters and advocates of various approaches to parallel computing. IBM skeptic Alan Karp, reacting to announcements of nCUBE’s 1024-microprocessor system and Thinking Machines’ 65,536-element array, made a public $100 wager that no one could get a parallel speedup of over 200 on real HPC workloads. Read more…

By John Gustafson & Lenore Mullin

Delays, Smoke, Records & Markets – A Candid Conversation with Cray CEO Peter Ungaro

October 5, 2017

Earlier this month, Tom Tabor, publisher of HPCwire and I had a very personal conversation with Cray CEO Peter Ungaro. Cray has been on something of a Cinderell Read more…

By Tiffany Trader & Tom Tabor

Flipping the Flops and Reading the Top500 Tea Leaves

November 13, 2017

The 50th edition of the Top500 list, the biannual publication of the world’s fastest supercomputers based on public Linpack benchmarking results, was released Read more…

By Tiffany Trader

Intel Launches Software Tools to Ease FPGA Programming

September 5, 2017

Field Programmable Gate Arrays (FPGAs) have a reputation for being difficult to program, requiring expertise in specialty languages, like Verilog or VHDL. Easin Read more…

By Tiffany Trader

HPC Chips – A Veritable Smorgasbord?

October 10, 2017

For the first time since AMD's ill-fated launch of Bulldozer the answer to the question, 'Which CPU will be in my next HPC system?' doesn't have to be 'Whichever variety of Intel Xeon E5 they are selling when we procure'. Read more…

By Dairsie Latimer

  • arrow
  • Click Here for More Headlines
  • arrow
Share This