Grid Computing: Square Pegs, Round Holes and a Good Cigar

By By Mike Bernhardt, Contributing Author

July 11, 2005

I recently polled several colleagues and Grid evangelists from both the vendor and end-user communities to gather a fresh perspective on the continued state of confusion surrounding the rate of Grid adoption and just how to size this market. The responses I got were fairly consistent and — no surprise to my readers, I'm sure — notably laced with frustration:

  • “Trying to discuss how Grid fits into the enterprise can be as frustrating as squeezing the proverbial square peg into a round hole.”
  • “The problem in trying to understand the potential market for Grid deployments is that we're trying to compare apples to oranges … and bananas … and grapefruits … and lemons.”
  • “There are way too many definitions for Grid — we need better standards … and industry-standard definitions.”

And, my favorite:

  • “What a crock … that's not even a Grid!”

According to Robert Fogel, director of worldwide Grid strategy and business development at Intel, it is fruitless to debate what is a Grid and what is not a Grid.

Fogel: “A far more beneficial debate would be a discussion of which use cases should be considered within scope and which ones are out of scope for a given specification or product.”

Fogel believes that blaming the state of confusion surrounding the Grid computing market on a lack of standards is “putting the solution cart before the problem horse.”

This writer couldn't agree more. But, I wanted something more concrete. I wasn't looking for the cart, I was looking for the horse. And I wanted to hear what was going on — straight from the horse's mouth.

So, I made a few calls to see who might be interested in sitting down with me for a bit of a secret chat — a candid discussion with no hype.

It's not hard to find the big-name end-users of Grid computing these days. The vendors quite proudly put them on display, and then work hard to keep them loyal. It's a beautiful thing.

And, like most of us who enjoy the luxury of being backseat drivers, I have some pretty strong feelings already about the winners and the “wannabes” in the Grid market. But, thinking back to some pretty exciting years of HPC innovation, I was wrong once before (ok, maybe twice) — and I still own a wheel barrel full of that worthless stock. So, I must admit, I tend to be a bit less emotional and a lot more skeptical these days.

I know how the marketing drill works. I've been on the other side of the fence, working with customers who know it is in their best interest to paint a rosy picture while they hide their Band-Aids and scars from the public. If things in the Grid market were really as good as some would like us to believe, we'd all be relaxing at some Caribbean resort sipping cool drinks. The square pegs just don't seem to be fitting well in those round holes. I was dialing for answers.

After just a few calls, I had a taker. And while I promised to keep this person's identity anonymous, I don't think the lack of an actual name will detract at all from the impact of this discussion.

So, there we were …

It was a Sunday morning. 10:30 a.m. Just a little chilly with a lingering freshness of the light rain that had fallen the night before. I arrived about 10 minutes early. Our rendezvous point was a tiny French coffee shop located in an almost hidden alley in a city that we won't name. I went in and ordered a large house coffee, with two shots of espresso, and room for lots of cream. With my steaming mug in hand, I strolled outside and grabbed a table that seemed to be offset just enough to give us a sense of privacy. Feeling the chill in the air, I walked across the street to my car to grab my windbreaker out of the trunk. When I returned to the table and sat down, I realized I hadn't cleaned out my jacket pockets since last wearing it for a round of golf.

I pulled out several golf tees, a $20 bill, a cigar cutter, a lighter and two of my favorite cigars — La Aurora Sapphire Preferidos — in their haunting blue canisters. I stared at the cigars. How could I have forgotten two extremely rare cigars like this — and not returned them to my humidor?

As I was pondering my own state of absent mindedness, my guest arrived. We'll just call him Mr. Preferido. We shook hands and he slapped me on the back and said, “Alright — cigars and espresso to start the day. I love it!”

He strolled inside to get some coffee and I thought, “Sure. Why not?” I had just recently been reacquainted with the enjoyment of a good cigar and a strong cup of coffee. And, from experience, I know that many executives seem to be quite reflective when enjoying a good cigar.

Ten minutes later, we were puffing on cigars, talking about golf and slowly working our way around to the topic of Grid computing. But, eventually, we got there.

I should point out that my guest wields a pretty heavy pen. His IT budget is a mid-cap company all in itself. I turned on my tape recorder. We talked. We sipped. We puffed. It was a great day.

Mr. Preferido: “Mike, the problem I see with a number of my peers is that they have been handed this powerful new tool (Grid), and no manual on how to use it. So, they wrap all their thinking around doing the same old job they always did — just trying to use a new tool — when, in fact, they should be thinking of new ways to do the job now that this tool called Grid computing has taken away many of the limitations they previously faced.”

He puffed on his Sapphire stogie, watched the smoke slowly rising to the top of our bistro table umbrella and then he continued.

“Now, I find this fascinating — and relevant. Six out of 10 senior executives surveyed at a recent focus group said they now use some type of electronic, hand-held personal assistant to help manage their lives. Several indicated they were completely organized and running their lives from their cell phone devices. Is it interesting that four out of 10 executives are still holding out and relying on hard copy day planners and some level of support from a trusted personal (human) assistant? Or, is it more interesting that the 60 percent indicated the use of new (PDA) technology for planning and organizing their lives has helped them to change their “processes,” change they way they approach each day, and manage their business and their daily activities?

“To me, that's what Grid is all about. It's about thinking differently. You need to go back and redefine the problems you are trying to address — with an open mind toward the new possibilities that we're starting to see with Grid and SOA.”

“I think a big part of the problem here is in the way we label things. We have too many people moving way too fast wanting to label the solutions without taking time to articulate and fully understand the problems they are trying to address.”

He continued with, “Discussions of market size and available market give me heartburn.”

We'll get back to Mr. Preferido, but first let us frame the problem I'm hoping to address. Several other end-users I spoke with voiced their frustration at trying to understand and model the market dynamics, while several of the vendors, those with a stake in understanding the landscape and available market, voiced their confusion and frustration as coming from the way analysts are looking at the market.

Well, guess what folks. The analysts are every bit as frustrated.

This is a difficult job. We seem to have forgotten that the technology sector lives in a vicious cycle. The end-users tell the analysts what technology they need and what products they will spend money on. Then, the analysts tell the vendors what demographics will be spending money — how much and on what. Then, the vendors use the information from the analysts to validate the available market and make decisions on product direction, engineering, manufacturing and timing. Then, the analysts tell the world how things are going based on the progress of the vendors and the sales and installations of the end-users.

So, imagine how difficult this is when everyone is speaking a different language.

That's pretty much where we are with trying to define the Grid market: square pegs, round holes, different languages.

Kelly Vizzini, chief marketing officer at DataSynapse, summarized it pretty well. “The very fact that Grid computing is applicable across the entire application, system and data stack guarantees that vendors in each space will have their own messaging.”

In my opinion, the industry champions have inadvertently created a communications challenge and it has placed the Grid market in a cloud of confusion. I also think we can better define the Grid market if we step back — or up — and look at Grid within the context of the bigger picture.

Experts such as Fogel and Vizzini, along with well-respected Grid evangelist Wolfgang Gentzsch, a former Sun Grid strategist now with MCNC, agree on a few things, though. The market opportunity for Grid needs to be looked at within the context of its impact on future enterprise infrastructures. Will companies continue to invest in new computing platforms, software and networks without Grid? Sure they will. However, let's not get hung up on trying to define exactly how many dollars are being spent on Grid infrastructures. Instead, let's focus on the benefits brought about by a well-planned Grid implementation.

If you take an existing computing infrastructure and make it Grid-enabled, do you go back and reclassify all the money you spent previously on that infrastructure as an investment in Grid? Of course not. Making it Grid-enabled is adapting it to the times. Money spent to buy servers or clusters prior to the implementation of a Grid is a hardware purchase of servers or clusters and should not be counted as an investment in Grid computing.

Now, back to Mr. Preferido.

We took a break to get some hot coffee and a pastry. Now it was time to get down to something more concrete.

Me: “I heard — very confidentially of course — that your organization is planning a major computing system infrastructure procurement in 2006 that would also represent a major venture into building a Grid computing environment. I heard that you were allocating close to $100 million to build this new Grid computing infrastructure.”

This brought a big smile, a chuckle and a comment of, “Well, isn't that interesting?”

Mr. Preferido: “I know where that number came from and that's not exactly how I portrayed the information.”

Using the base number of $100 million to build a new computing infrastructure, we worked through his very rough plans and agreed that the following would be the most accurate way to categorize how the money was going to be used: $20 million in networking equipment and upgrades; $60 million in new computing platforms, specifically clusters (with software licenses) and a significant amount of storage; $150,000-$200,000 dollars in Grid infrastructure middleware; and the remaining $19 million was for facilities, staff and operations costs.

Now, just to recap, I was told in confidence by someone outside of this organization who frequently states opinion about the potential for the Grid market, that this company was planning an investment of $100 million to build a major Grid computing infrastructure.

Mr. Preferido said he would classify this as a $200,000 Grid sale, as everything would be installed, up and running regardless of their ability to Grid-enable the entire infrastructure.

Do you start to see where the disconnect is? At least one person out there is counting this as a $100 million Grid sale.

The only way to tell what's really going on is to follow the money. I've seen several impressive marketing budgets in the Grid space, but no one is talking about revenue. I've talked to numerous investors about the space and I certainly don't have to be sold on the excitement. But, is anyone really making money in this space?

Once again, I turned to DataSynapse's Vizzini, who told me the company has experienced triple-digit revenue growth every year since its inception. Triple digit revenue growth! That's impressive in any market. And, sure enough — after speaking with a number of end-users — if there's anyone making money out there, I would believe it is DataSynapse.

What I find quite refreshing is that DataSynapse is one of the most conservative companies out there when it comes to talking about the Grid computing market. The DataSynapse spokespeople are very careful to clarify, be factual and avoid hype. Bravo.

We discussed some more that may show up in a future column, but we had to bring this interview to a close. I feel like I was able to make more headway in understanding some of the Grid market dynamics just by taking an hour to enjoy a good cigar, sip some very strong coffee and have a non-hurried conversation where no one was trying to sell anything.

Thanks, Mr. Preferido. I will be sending you that box of cigars as promised.

So, if we don't bog ourselves down in the mud with all the confusion over labels, and if we focus more on the big picture where Grid is an enabling component of a new enterprise architecture, and we stop trying to create a market projection that's intended to pad an ambitious marketing plan, we may just get through this.

The pegs do fit — if you take the time to find the right holes. Maybe everyone is just trying to move a little too fast.

There are some great success stories out there. There are many interesting examples of Grid being applied to boost productivity and performance. And there's a tremendous opportunity to start thinking about the way we approach computational and data manipulation problems. Therein lies the challenge.

It's about a new way of thinking. Think about it.

And while you're thinking about it, relax. It's all good.

Enjoy!

About Mike Bernhardt

Mike Bernhardt is a contributing writer and columnist for GRIDtoday and a consultant with 30 years of experience in helping companies develop sound, executable take-to-market strategy. Bernhardt can be reached at [email protected].

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Mira Supercomputer Enables Cancer Research Breakthrough

November 11, 2019

Dynamic partial-wave spectroscopic (PWS) microscopy allows researchers to observe intracellular structures as small as 20 nanometers – smaller than those visible by optical microscopes – in three dimensions at a mill Read more…

By Staff report

IBM Adds Support for Ion Trap Quantum Technology to Qiskit

November 11, 2019

After years of percolating in the shadow of quantum computing research based on superconducting semiconductors – think IBM, Rigetti, Google, and D-Wave (quantum annealing) – ion trap technology is edging into the QC Read more…

By John Russell

Tackling HPC’s Memory and I/O Bottlenecks with On-Node, Non-Volatile RAM

November 8, 2019

On-node, non-volatile memory (NVRAM) is a game-changing technology that can remove many I/O and memory bottlenecks and provide a key enabler for exascale. That’s the conclusion drawn by the scientists and researcher Read more…

By Jan Rowell

What’s New in HPC Research: Cosmic Magnetism, Cryptanalysis, Car Navigation & More

November 8, 2019

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

Machine Learning Fuels a Booming HPC Market

November 7, 2019

Enterprise infrastructure investments for training machine learning models have grown more than 50 percent annually over the past two years, and are expected to shortly surpass $10 billion, according to a new market fore Read more…

By George Leopold

AWS Solution Channel

Making High Performance Computing Affordable and Accessible for Small and Medium Businesses with HPC on AWS

High performance computing (HPC) brings a powerful set of tools to a broad range of industries, helping to drive innovation and boost revenue in finance, genomics, oil and gas extraction, and other fields. Read more…

IBM Accelerated Insights

Atom by Atom, Supercomputers Shed Light on Alloys

November 7, 2019

Alloys are at the heart of human civilization, but developing alloys in the Information Age is much different than it was in the Bronze Age. Trial-by-error smelting has given way to the use of high-performance computing Read more…

By Oliver Peckham

IBM Adds Support for Ion Trap Quantum Technology to Qiskit

November 11, 2019

After years of percolating in the shadow of quantum computing research based on superconducting semiconductors – think IBM, Rigetti, Google, and D-Wave (quant Read more…

By John Russell

Tackling HPC’s Memory and I/O Bottlenecks with On-Node, Non-Volatile RAM

November 8, 2019

On-node, non-volatile memory (NVRAM) is a game-changing technology that can remove many I/O and memory bottlenecks and provide a key enabler for exascale. Th Read more…

By Jan Rowell

MLPerf Releases First Inference Benchmark Results; Nvidia Touts its Showing

November 6, 2019

MLPerf.org, the young AI-benchmarking consortium, today issued the first round of results for its inference test suite. Among organizations with submissions wer Read more…

By John Russell

Azure Cloud First with AMD Epyc Rome Processors

November 6, 2019

At Ignite 2019 this week, Microsoft's Azure cloud team and AMD announced an expansion of their partnership that began in 2017 when Azure debuted Epyc-backed ins Read more…

By Tiffany Trader

Nvidia Launches Credit Card-Sized 21 TOPS Jetson System for Edge Devices

November 6, 2019

Nvidia has launched a new addition to its Jetson product line: a credit card-sized (70x45mm) form factor delivering up to 21 trillion operations/second (TOPS) o Read more…

By Doug Black

In Memoriam: Steve Tuecke, Globus Co-founder

November 4, 2019

HPCwire is deeply saddened to report that Steve Tuecke, longtime scientist at Argonne National Lab and University of Chicago, has passed away at age 52. Tuecke Read more…

By Tiffany Trader

Spending Spree: Hyperscalers Bought $57B of IT in 2018, $10B+ by Google – But Is Cloud on Horizon?

October 31, 2019

Hyperscalers are the masters of the IT universe, gravitational centers of increasing pull in the emerging age of data-driven compute and AI.  In the high-stake Read more…

By Doug Black

Cray Debuts ClusterStor E1000 Finishing Remake of Portfolio for ‘Exascale Era’

October 30, 2019

Cray, now owned by HPE, today introduced the ClusterStor E1000 storage platform, which leverages Cray software and mixes hard disk drives (HDD) and flash memory Read more…

By John Russell

Supercomputer-Powered AI Tackles a Key Fusion Energy Challenge

August 7, 2019

Fusion energy is the Holy Grail of the energy world: low-radioactivity, low-waste, zero-carbon, high-output nuclear power that can run on hydrogen or lithium. T Read more…

By Oliver Peckham

Using AI to Solve One of the Most Prevailing Problems in CFD

October 17, 2019

How can artificial intelligence (AI) and high-performance computing (HPC) solve mesh generation, one of the most commonly referenced problems in computational engineering? A new study has set out to answer this question and create an industry-first AI-mesh application... Read more…

By James Sharpe

Cray Wins NNSA-Livermore ‘El Capitan’ Exascale Contract

August 13, 2019

Cray has won the bid to build the first exascale supercomputer for the National Nuclear Security Administration (NNSA) and Lawrence Livermore National Laborator Read more…

By Tiffany Trader

DARPA Looks to Propel Parallelism

September 4, 2019

As Moore’s law runs out of steam, new programming approaches are being pursued with the goal of greater hardware performance with less coding. The Defense Advanced Projects Research Agency is launching a new programming effort aimed at leveraging the benefits of massive distributed parallelism with less sweat. Read more…

By George Leopold

AMD Launches Epyc Rome, First 7nm CPU

August 8, 2019

From a gala event at the Palace of Fine Arts in San Francisco yesterday (Aug. 7), AMD launched its second-generation Epyc Rome x86 chips, based on its 7nm proce Read more…

By Tiffany Trader

D-Wave’s Path to 5000 Qubits; Google’s Quantum Supremacy Claim

September 24, 2019

On the heels of IBM’s quantum news last week come two more quantum items. D-Wave Systems today announced the name of its forthcoming 5000-qubit system, Advantage (yes the name choice isn’t serendipity), at its user conference being held this week in Newport, RI. Read more…

By John Russell

Ayar Labs to Demo Photonics Chiplet in FPGA Package at Hot Chips

August 19, 2019

Silicon startup Ayar Labs continues to gain momentum with its DARPA-backed optical chiplet technology that puts advanced electronics and optics on the same chip Read more…

By Tiffany Trader

Crystal Ball Gazing: IBM’s Vision for the Future of Computing

October 14, 2019

Dario Gil, IBM’s relatively new director of research, painted a intriguing portrait of the future of computing along with a rough idea of how IBM thinks we’ Read more…

By John Russell

Leading Solution Providers

ISC 2019 Virtual Booth Video Tour

CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
GOOGLE
GOOGLE
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
VERNE GLOBAL
VERNE GLOBAL

Intel Confirms Retreat on Omni-Path

August 1, 2019

Intel Corp.’s plans to make a big splash in the network fabric market for linking HPC and other workloads has apparently belly-flopped. The chipmaker confirmed to us the outlines of an earlier report by the website CRN that it has jettisoned plans for a second-generation version of its Omni-Path interconnect... Read more…

By Staff report

Kubernetes, Containers and HPC

September 19, 2019

Software containers and Kubernetes are important tools for building, deploying, running and managing modern enterprise applications at scale and delivering enterprise software faster and more reliably to the end user — while using resources more efficiently and reducing costs. Read more…

By Daniel Gruber, Burak Yenier and Wolfgang Gentzsch, UberCloud

Dell Ramps Up HPC Testing of AMD Rome Processors

October 21, 2019

Dell Technologies is wading deeper into the AMD-based systems market with a growing evaluation program for the latest Epyc (Rome) microprocessors from AMD. In a Read more…

By John Russell

Intel Debuts Pohoiki Beach, Its 8M Neuron Neuromorphic Development System

July 17, 2019

Neuromorphic computing has received less fanfare of late than quantum computing whose mystery has captured public attention and which seems to have generated mo Read more…

By John Russell

Rise of NIH’s Biowulf Mirrors the Rise of Computational Biology

July 29, 2019

The story of NIH’s supercomputer Biowulf is fascinating, important, and in many ways representative of the transformation of life sciences and biomedical res Read more…

By John Russell

Xilinx vs. Intel: FPGA Market Leaders Launch Server Accelerator Cards

August 6, 2019

The two FPGA market leaders, Intel and Xilinx, both announced new accelerator cards this week designed to handle specialized, compute-intensive workloads and un Read more…

By Doug Black

With the Help of HPC, Astronomers Prepare to Deflect a Real Asteroid

September 26, 2019

For years, NASA has been running simulations of asteroid impacts to understand the risks (and likelihoods) of asteroids colliding with Earth. Now, NASA and the European Space Agency (ESA) are preparing for the next, crucial step in planetary defense against asteroid impacts: physically deflecting a real asteroid. Read more…

By Oliver Peckham

When Dense Matrix Representations Beat Sparse

September 9, 2019

In our world filled with unintended consequences, it turns out that saving memory space to help deal with GPU limitations, knowing it introduces performance pen Read more…

By James Reinders

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This