Digipede Seeking to End Windows Neglect

By By Derrick Harris, Editor

July 4, 2005

GRIDtoday editor Derrick Harris recently spoke with Digipede Technologies CEO John Powers about what the company is expecting with its product launch next quarter (see “Digipede Ships Grid Software for Microsoft Windows” in this issue), how it plans to infiltrate users from the bottom up and, perhaps most importantly, why Digipede is focused on bringing Grid to mainstream Windows users — a market Powers calls “gigantic and lightly contested.”



GRIDtoday:
First, can you give a brief description of the Digipede Network? Is this solution all an end-user will need to harness the benefits of Grid computing?

JOHN POWERS: The Digipede Network is a distributed computing solution that delivers dramatically improved performance for real-world business applications. The software scales from a handful of computing nodes to thousands. Built entirely on the .Microsoft NET platform, the Digipede Network is radically easier to buy, install, learn and use than other Grid computing solutions.

And yes, our system allows users to harness the benefits of Grid computing in several ways, but in each case, our designers have strived to make this the easiest distributed computing product on the market.

If a user has an existing command-line process they need to distribute and run on their network, the Digipede Workbench provides a simple, graphical user interface to make that task easy. Instead of requiring any shell scripting to move applications and data around, the Workbench makes it simple for a non-developer to get into Grid, quickly and easily.

The Digipede Network can also work with applications that are already installed on compute resources—again, using the powerful, flexible Digipede Workbench.

Lastly, the Digipede Framework development tools make it straightforward for developers to create Grid-enabled applications themselves.

Gt: Digipede is unique in that it caters specifically to Windows users and .NET applications. What is the reason for this targeted market?

POWERS: I like markets that are gigantic and lightly contested. Windows is the dominant operating system on the planet. Period. We are continually amazed at the Grid community's neglect of Windows. When we talk to customers — in biotech, finance, energy and beyond — they are continually amazed at the Grid community's neglect of Windows.

As for .NET, let's be clear. The Digipede Network is built entirely on .NET, but we can distribute applications built with any technology that runs on Windows 2000 or later — including .NET, COM, Java or, for that matter, standalone executables developed in Fortran or C.

When we talk to customers, they tell us, very clearly:

  • Most applications run on a single operating system, not multiple operating systems. “Cross-platform” is a wonderful idea in the abstract, but the customers we talk to are not willing to incur the extra expense and complexity required to run a single application across multiple platforms simultaneously.
  • Most developers use Visual Studio .NET to build applications. It's the tool preferred by most developers of enterprise applications, both internal developers and ISVs.
  • Most computers run Microsoft Windows. For a large class of customers, the added complexity of maintaining a cross-platform distributed computing system is not worth the extra 10 or 20 percent of compute resources they could capture. It is far more important for these customers to support a heterogeneous combination of dedicated and shared resources running Windows (e.g., cluster nodes, desktops and departmental servers) than multiple operating systems.

But our focus on the Microsoft platform goes beyond Microsoft's present technology and market share. Microsoft is a terrific partner, and their partner ecosystem is just unbelievable. As Microsoft Gold Certified partners, we've received marketing support, access to their product managers, insights into their product roadmap and numerous other benefits. This month, we are participating in a three-day Microsoft Worldwide Partner conference, where we will meet with dozens of potential partners — ISVs, OEMs, system builders, resellers, integrators — and we're committed to playing an important role in the Microsoft distributed computing ecosystem.

Gt: Will the company be releasing solutions for any other platforms or operating systems in the future?

POWERS: Digipede is committed to inter-operating with solutions released on other operating systems. Digipede has no plans to release its own products on other operating systems.

Gt: What kind of response have you received since announcing the public beta program in April? How have the early beta customers that have been on board since before February responded?

POWERS: Our beta customers have been very pleased — and we're very pleased with the help they've provided to us. The variety of applications (including some we never expected) has been most gratifying and helpful to us in ensuring the Digipede Network can support applications not usually classified as “High Performance Computing (HPC).” While the HPC market is important to us, there is a much larger market of mainstream enterprise software that can benefit greatly from improved application performance.

Gt: One of the real draws of the Digipede Network, especially the Team Edition, seems to be the low price tag. Can you explain the rationale behind the pricing scheme?

POWERS: As we have talked to customers in this market — and we talk with lots and lots of customers and potential customers — the feedback we've received about Grid computing has been remarkably consistent. Price, per se, is not a barrier to adoption. The number one barrier to adoption is complexity.

With that complexity has come a very high threshold for the adoption of Grid solutions. When you need consultants, long feasibility studies and longer implementation projects just to get in the game, that's a high threshold for most customers to cross. As a result, Grid customers tend to be very large organizations, and they tend to spend a lot of time and money dealing with complex installation, configuration, integration, training and support issues.

Our goal is to eliminate complexity wherever possible, and to provide a much lower entry point. As you weed out complexity, you open this market to a much wider range of customers. That's how the benefits of Grid computing will really start to show up — when they reach small to medium businesses and individual departments within larger organizations. That's where the energy is, that's where the innovation is and that's where the greatest needs are.

Our pricing is part of that strategy. When you can buy great Grid computing software for under a thousand dollars, when you can get it installed and running without spending a dollar on consultants, then it's much easier to get started. You don't have to cross this high threshold of cost and complexity — you can get started today and see the benefits for yourself, in your own organization, and then add more power as you need it.

When you talk with folks in small and medium businesses, and in small and medium labs and departments within much larger organizations, you find out: they buy products that solve problems. They are not going to do an organizational transformation consulting project to improve application performance. They're going to buy something they can use right away, without a lot of fuss.

We don't see our product as dramatically lower-priced than other solutions out there; our price per node is fairly similar to other offerings. The real difference is the lower entry point; the simplicity of implementation makes it possible for us to support a five-node sale. Our competition can't say that.

Gt: Can SMBs really expect to see results from a Grid of, say, five nodes?

POWERS: Absolutely. If your most important analytic application runs for an hour on a single machine, and we can cut that time to 12-15 minutes with a five-node implementation of the Digipede Network Team Edition, that's a big deal. That means, for example, an analyst can get four or five times as many model runs done in a day as before, which changes the way he or she works every day. And, of course, the Team Edition isn't capped at five nodes; once that business sees how easy it is to achieve the benefits of distributed computing, they can add up to 20 Digipede Agents to further increase the throughput of their applications.

And that's exactly what we see happening. I'll give you another example. One of our beta customers is a company called InBoxer. They make an advanced spam filtering product, and they do a lot of statistical modeling — their classification of e-mail as spam or not spam gets better the more they calibrate it by exposing it to huge amounts of e-mail. Their statistical models were running all night on a single processor. They got the Digipede Network, installed the Digipede Agents on four or five machines, and saw an immediate impact; their jobs were cut down to less than two hours. Their CTO was so impressed that he went shopping — he bought several additional servers, deployed additional Digipede Agents on those servers, and they're down to about 40 minutes on those same jobs. That's huge for them — it completely changes the way they interact with their data and their models, and the pace at which they can improve and grow their business. And we made exactly zero trips out to help them with this — they got everything up and running themselves.

Gt: What about the Professional Edition? How does Digipede stack up against other vendors (e.g., IBM, Sun Microsystems, Platform Computing) targeting large IT departments?

POWERS: The Digipede Network Team Edition and Professional Edition are developed with the same code base. We want Professional Edition to preserve the ease of deployment and use that we've built into the Team Edition. We also wanted to provide a very clean upgrade path from Team Edition to Professional Edition. This is critical, because we see some very, very big companies — Fortune 50 companies — looking at Team Edition. Is that because they want to limit their use of Grid computing to five or 20 machines? Of course not. It's because at the department level, where the application performance bottlenecks are most apparent, they want to experiment with a small system before they commit to a wider deployment.

That brings up a fundamental difference, not in technology, but in customer focus. You asked about “targeting large IT departments,” and I think that's where we're different from most Grid vendors. We're not targeting large IT departments — at least, not directly. Good IT departments — large and small — listen to the needs of their users. The Digipede Network Professional Edition is targeted at the needs of users and IT departments alike. Yes, IT departments will like it because of its ease of implementation and administration but, primarily, we're building in features that help users be more productive.

Professional Edition includes some additional features required for the support of larger departments and businesses. Professional Edition allows:

  • An unlimited number of Digipede Agents.
  • An unlimited number of users.
  • The definition of multiple resource pools, (e.g., the accounting department pool, the third-floor dedicated cluster, the “nights and weekends” pool, the “all resources” pool) with different user privileges on each pool.
  • Setting different priorities for different jobs.

As for how it compares to offerings from IBM, Sun, Platform and others, well, really the whole approach is a little different. There's no question that there are advantages and disadvantages to each vendor's approach, and types of applications that are better suited for each vendor. We've placed a premium on ease of deployment, ease of use and ease of application integration. Others have placed a premium on cross-platform execution, “command and control” scheduling for the tightest possible control of dedicated clusters and so on. We think that there's a big, underserved market focused on the same priorities as we are with the Digipede Network Professional Edition. We'll see when we release it next quarter.

Gt: It is often said that the complexity of Grid-enabling existing applications is one obstacle companies face when deploying a Grid infrastructure. How does the Digipede Framework (API) ease this burden?

POWERS: This is a really important area for us. The whole Digipede team comes from the enterprise software industry, and we're keenly aware of the needs of developers. We realize that application developers know their applications well and want to focus on the functionality their applications deliver — not on the nuts and bolts of distributed computing.

The Digipede Framework provides developers with the easiest path available for Grid-enabling their applications. It fits right into Visual Studio .NET, which means all the documentation is accessible the same way the MSDN documentation is, and that IntelliSense makes the Digipede Framework classes as easy-to-work-with as all of the .NET Framework. In short, we allow developers to work the way they're used to working, so developing a distributed application is no more difficult than developing any other kind of application.

The Digipede Framework API is remarkably simple for the complex functionality it enables. Developers pick the classes in their applications that they would like distributed, and derive those classes from our Worker object. At run time, each object of that class that they instantiate is automatically migrated by the Digipede Network to a machine ready to execute the work; a method is called by the agent, and the objects are re-serialized and streamed back into the calling application. Nearly all of the developer's code is unchanged; the object-oriented nature of .NET programming is preserved completely. The developer no longer needs to worry about the difficult parts of distributed computing: how and where to move the appropriate EXEs and DLLs, determining which computers are on the network and available for work, and guaranteeing execution by monitoring processes. All of those chores are taken care of by the Digipede Network so the developer can concentrate on his or her own application.

Gt: The ease-of-use and ease-of-implementation of the Digipede Network seem too good to be true. How can a Grid network be set up so smoothly out of the box?

POWERS: Too good to be true? Ah, that's a sad commentary on the state of Grid software today. I think ease of implementation and use are minimum standards for successful software! Think of all the very hard things that software has made easy. I don't view the process of editing digital photos as “easy” — it's a tremendously complex set of activities. But Adobe has made it easy by putting a lot of the complexity behind the scenes where I don't need to worry about it. I don't need to know what algorithms they use for redeye correction to make my kid's eyes look human — I'm sure some smart people at Adobe worked very hard on that — but now it just works.

Or, just look at a product like Microsoft SQL Server. There was a time when installing and administering a high end database took a full-time, highly trained employee. SQL Server is a product that you or I could install in minutes, and then just start using it. It scales up tremendously well (to over 20TB), but also scales down very well — the MSDE version of SQL server requires no administration at all, and is ideal for small installations. We are providing the same kind of product—we want to scale down as well as we scale up, and we will provide ease of use at all scales.

So, to me, your question is really one of priorities. We build ease of use and ease of implementation into our products through hard work because that's what our customers want.

Gt: You've stated that your target users are in the financial services and life sciences markets. How did you come to this conclusion? What other markets is Digipede targeting?

POWERS: Well, our initial focus is in the areas you cited because that's where we've seen a lot of pain and money and growth. We're certainly getting a lot of interest from these areas. When we go to a biotech company and see Ph.D. bioinformaticians struggling with Perl scripts for weeks and months, trying to cobble together their own home-brew distributed computing system, that's an opportunity. When we see Ph.D. economists and financial engineering wizards being told the have to ditch their preferred development environment and hire Linux systems administrators just to speed up their applications, that's an opportunity.

But certainly, we're seeing interest from other fields. My background is in energy, and that's certainly a lively area. Video processing of all types is a growth area not being well addressed. I‘m not just talking about rendering animation and special effects, but media repurposing of every sort. The storage guys have figured out how important this area is, but this isn't just a storage problem. And, of course, there's the “other” category, which looks to be a pretty interesting category, as my earlier InBoxer example shows.

Gt: Have you seen The 451 Group's report on Grids in the pharmaceutical sector, which generally falls under “life sciences?” How will Digipede go about gaining ground in this apprehensive field?

POWERS: I think that's a valuable report, and the observations and conclusions in it are quite consistent with my own view of that market. “Pharma” has been the victim of IT hype for decades, and many people in the sector feel that Grid is just the latest technology being thrust at them with unrealistic promises. The top-down sale, which says “transform your company and then you can achieve the astonishing benefits of Grid,” is just not going to work in pharma. The way Grid will succeed in pharma — and in other industries — is the hard way, from the bottom up. We go directly to the departments with the problems, where application performance is a real bottleneck. Even those folks are skeptical, but are willing to experiment with the right solution.

Gt: We haven't heard much from Microsoft in regard to Grid computing. How will Digipede's partnership with Microsoft affect, or be affected by, a decision by Microsoft to start pushing Grid solutions?

POWERS: Our whole team has been working with Microsoft for about 17 or 18 years across three previous companies. We're doing everything we can to align ourselves with Microsoft's strategy in high-performance computing, in distributed computing more broadly, in specific verticals and more. While Microsoft doesn't use the word “Grid” very often, they're getting more active in HPC. They're pushing very hard on 64-bit Windows. They're beefing up their support for high-speed interconnects. I've been up to Redmond (Wash.) several times to meet with the team building Windows Server 2003 Compute Cluster Edition, which will be out next year. All that is very good for us; while nothing we've done requires CCE or 64-bit Windows, we'll benefit from it. The more credible Microsoft is within the HPC community, the more the Digipede Network will take hold there.

But as I said earlier, we all come out of the enterprise computing field, not the HPC field. Our Microsoft strategy extends to Visual Studio .NET, the most widely-used enterprise development tools around. Enterprise software developers can scale out their applications with the Digipede Network with just a few lines of code. That market is, conservatively, 10 times the size of the HPC market, and we're completely aligned with Microsoft's strategy here. We're building capabilities on top of .NET, just as they hope their partners will do.

Gt: Is there anything else you would like to add?

POWERS: I want to thank GRIDtoday for the great job you're doing in covering this market, and to encourage you to look closely at what's going on in the SMB market.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire