On the Origin of Utility Computing, Pt. 2

By By Derrick Harris, Editor

October 1, 2007

In Part 2 of our look at what has become of utility computing, we focus on two utility solutions that have redefined what the term means.

Since the idea of utility computing first came to be, the assumption by most was that it had to be an outsourced service, just like the energy utility from which it takes its name. As is prone to happen, however, utility computing has evolved into some forms — including some located within a user’s own datacenter — that bear little resemblance to their not-so-ancient ancestors. Companies like Cassatt and 3Tera are among a group of vendors who are out to show that as long as you have on-demand access to your resources — when you need them and at the level you need them — you have utility computing.

Turning Your Datacenter Into a Utility

No matter how appealing the prospect of having mission-critical applications and services run externally, and thus saving on the associated management costs, an outsourced model of utility computing just isn’t an option for some customers, particularly those with ultra-sensitive customer data. Luckily for them, Cassatt has taken it upon itself to give businesses the utility attributes they crave in-house.

According to director of product management and marketing Ken Oestreich, Cassatt’s definition of utility computing includes abilities around: pooling all datacenter resources (compute and network) in a software- and hardware-agnostic manner; controlling that pool with a set of user-defined policies; and metering of capacity, utilization and cost. (At Cassatt, said Oestreich, “It’s not a utility if it doesn’t have meter.”) Also inherent — and, in fact, necessary — in a utility model is capacity on-demand. “The negative definition of utility computing,” he elaborated, “is: You don’t have a separate capacity manager, and you don’t have a separate high availability manager. They’re part of the fabric or part of the inherent infrastructure.”

This vision has been realized in Collage, Cassatt’s “datacenter operating system” that was designed from the ground-up with these capabilities in mind. Among its more unique traits is the fact that Collage, unlike comparable solutions offering a “cloud” or “pool” of resources, does not rely on virtualization. In fact, said Oestreich, although it does support virtualization in a platform-agnostic manner, Collage doesn’t require customers wishing to move workloads to utilize virtualization at all. “We’re saying, ‘Whatever you have in your datacenter today, virtualized or not, whatever platform you have, you should be able to make that cloud.’”

This is accomplished, Oestreich explained, by capturing images of workload (from the operating system on up), removing the hardware-specific data and repopulating that data specific to the new machine. Even in this world of seemingly omnipresent virtualization, Oestreich said the folks behind Collage realized that users running certain data-sensitive applications, such as big scale-out databases, want to move workloads around as demand dictates without suffering the performance hits that come with running them on virtual machines.

Another big differentiator with Collage is the metering function, which takes many variables into account, thus enabling IT departments to bill other departments or lines of business on a per service basis versus a standard per usage or per machine basis. In addition, Collage’s meter also differs from many others in terms of monitoring. Whereas many metering tools are designed simply to display status and alerts, Oestreich says Collage allows users to monitor capacity on a datacenter-wide basis (against user-defined service levels), opening up the abilities to meter utilization and forecast capacity.

Cassatt currently has about a dozen customers, including in the financial services and government sectors, and is doing a good number of proofs-of-concept, and response has been overwhelmingly positive thus far, said Oestreich. That being said, he pointed out that while the technology generally wows potential customers — to the point where the company is starting to develop starting points that allow customers who can’t digest it all at once to start slower — organizational issues do arise on occasion. “The ‘gotcha,’ if you will, is there’s one thing utility computing offers that customers aren’t ready for,” explained Oestreich, “… which is because you’re pooling resources, because you’re sharing infrastructure, customer organizations aren’t always ready for it.” To deal with this issue, Cassatt has partnered with technology consultant BearingPoint, who helps customers ease the pain (if you can call it that) of consolidating their numerous silos, as well as the resources required to manage them.

Not surprisingly, even Cassatt acknowledges that its cutting-edge technology and unique take on utility computing are still in the early adoption phase. However, said Oestreich, the more people become comfortable with virtualization, the more they are becoming comfortable with concepts like automation and utility computing. While it might be a few years before technologies like Collage reach the current adoption level of virtualization, Oestreich said pioneers, as well as everyone with a big datacenter, already are asking about Cassatt’s utility vision.

Bringing a Utility Hosting Star In-House

In yet another example of how the notion of utility computing has evolved to encompass in-house versions as well as outsourced ones, 3Tera has decided to sell its previously-available-only-to-hosting-providers AppLogic software direct to end-users.

According to Bert Armijo, 3Tera vice president of marketing and product management, this notion came about after demonstrating the Super Grid with Layered Technologies (see www.gridtoday.com/grid/1758320.html), when several customers — including banks, insurance companies and very large social networks — that would not fit into the hosting customer demographic began inquiring about getting AppLogic in their datacenters. Although outsourcing computing isn’t too real a possibility for these customers, Armijo said their underlying needs are the same: to eliminate the annoyance and expense associated with deploying dedicated resources for every application a company runs.

Considering that, by Armijo’s estimate, a decent-sized IT company is likely running several thousand applications, the traditional model equates to tremendous labor and time expenditures maintaining these resources. AppLogic solves this problem by allowing users to define a set of infrastructure components — CPU, firewall, load balancer, etc. — for an application and then run it on a fairly generic set of resources. The big difference between AppLogic and other solutions, says Armijo, is that AppLogic users operate at an application level and can add or remove resources from an application as needed without dealing with the individual server level. In fact, users can move applications from one datacenter to another with a single command.

In the name of being a true utility, AppLogic does have provisions for SLAs by increasing the number of instances or the amount of resources to each instance, and the in-house version includes the ability to proactively provision resources to lines of business or individual operators, or to meter resources by application or account. Armijo sees AppLogic’s utility capabilities being far more relevant to the software’s business case than its grid computing capabilities, which also are touted in any product literature.

At 3Tera, he said, they refer to “grid” strictly from a hardware infrastructure perspective, because actual grid computing requires applications to be written in specific languages, using specific toolkits and operating systems, that aren’t conducive to running normal, transactional applications. Grid computing’s hardware set-up was married with virtualization to create AppLogic. “The traditional grid has been around for quite a while and showed the world, quite frankly, how you could, in fact, get to utility computing,” added Armijo.

At the end of the day, though, AppLogic is a very forward-thinking solution (with a user interface that resembles a Microsoft Visio drawing), and while the kind of clamor that led to the in-house release might have come a little earlier than anticipated, the company definitely expected there to be demand for it at some point. “If you think about what any large IT operation is facing today in terms of dealing with the sprawl of servers, [or] datacenter upgrades to pull in more power,” said Armijo, “this makes absolute sense and doesn’t surprise me in any way.”

—–

To read Part 1 of this article, which discusses Sun Microsystems’ Network.com and Amazon’s Elastic Compute Cloud, click here.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that have occurred about once a decade. With this in mind, the ISC Read more…

2024 Winter Classic: Texas Two Step

April 18, 2024

Texas Tech University. Their middle name is ‘tech’, so it’s no surprise that they’ve been fielding not one, but two teams in the last three Winter Classic cluster competitions. Their teams, dubbed Matador and Red Read more…

2024 Winter Classic: The Return of Team Fayetteville

April 18, 2024

Hailing from Fayetteville, NC, Fayetteville State University stayed under the radar in their first Winter Classic competition in 2022. Solid students for sure, but not a lot of HPC experience. All good. They didn’t Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use of Rigetti’s Novera 9-qubit QPU. The approach by a quantum Read more…

2024 Winter Classic: Meet Team Morehouse

April 17, 2024

Morehouse College? The university is well-known for their long list of illustrious graduates, the rigor of their academics, and the quality of the instruction. They were one of the first schools to sign up for the Winter Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pressing needs and hurdles to widespread AI adoption. The sudde Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that ha Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use o Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pre Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announce Read more…

Nvidia’s GTC Is the New Intel IDF

April 9, 2024

After many years, Nvidia's GPU Technology Conference (GTC) was back in person and has become the conference for those who care about semiconductors and AI. I Read more…

Google Announces Homegrown ARM-based CPUs 

April 9, 2024

Google sprang a surprise at the ongoing Google Next Cloud conference by introducing its own ARM-based CPU called Axion, which will be offered to customers in it Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire