Univa Rescues Grid Engine From Oracle

By Michael Feldman

January 18, 2011

Univa announced today it would be acquiring the Sun/Oracle Grid Engine engineering expertise from Oracle Corp. In doing so, the company will take over stewardship of the popular open source workload manager, which, in the space of two years, has passed through three companies: Sun Microsystems, Oracle, and now Univa. Its new owners plan to support existing deployments of Grid Engine as well as develop a commercial version with added capabilities.

Although Univa is not talking publicly about the terms of the agreement (if any) that enabled them to spirit away the Grid Engine team from Oracle, Tuesday’s press release did specify that the principal engineers from Grid Engine team, including Grid Engine founder and original project owner Fritz Ferstl would be joining Univa. To sweeten the deal, Ferstl has been named CTO and will head the company’s EMEA business.

By jettisoning the Grid Engine team, Oracle is continuing to shed its associations with high performance computing, and with open source software, in general. Although Grid Engine is a general-purpose workload manager, and has many applications outside of HPC (including within Oracle’s own Enterprise Manager suite), the company is apparently not inclined to be the steward of this technology. At the very least, it is unwilling to develop and maintain the open source software for the larger community — that despite this gushing endorsement of Grid Engine that Oracle posted in September 2010 on its website:

“Following the acquisition, Sun Grid Engine came to Oracle Enterprise Manager and we are absolutely delighted to welcome OGE to the Enterprise Manager family. The product is absolutely fantastic and a leader in its market space. We plan to aggressively support and market this product.”

Or not.

Oracle’s original plan was to “enterprise up” the Grid Engine in order to make it more suitable for the company’s business-centered customer base. But apparently if someone else is willing to do the heavy lifting with regard to maintaining the foundational software, so much the better.

In passing the torch to Univa, Oracle is almost certainly doing the HPC community a big favor. The concern with Oracle was its antipathy in pursuing an HPC path for the technology. This would eventually have forced Grid Engine to fork into one or more commercial versions and possibly even multiple open source versions. This could still happen, but given Univa’s large base of HPC customers, its own stake in the software, and its experience with open source development, this is much less likely to occur.

According to Univa CEO Gary Tyreman, their plan is to keep all the Grid Engine users happy by ensuring everyone has a path forward. This includes those who elect to stay with the open source version (mainly government research labs and academic types), commercial users who need Grid Engine support but are not ready to upgrade, and those customers looking for a commercially-supported product and ongoing evolution of the software.

It also includes Univa itself, who currently employs the workload manager in its UniCluster offering. In addition, the company will rely on Grid Engine in its UniCloud product to manage workloads across distributed resources. As of late, the company is shying away from the cloud terminology, and replacing it with a “datacenter optimization” mantra that dovetails nicely with how Univa intends to use Grid Engine across its product portfolio.

The responsibility for Grid Engine also brings with it some strange bedfellows. For example, Univa is now in the position of supporting competing offerings, such as a Grid Engine-equipped Rocks Cluster distribution. “We are redrawing the competitive dynamics, not just for the industry, but in particular for ourselves,” notes Tyreman. “Overnight some of my competitors become my best friends.”

The overarching goal, he says, is to unify the community “as it was.” Tyreman insists they are committed to working with the Open Grid Scheduler (OGS) project, which will be the repository for the open source version of the software. “There will always be an open source version of Grid Engine available,” he declares.

Tyreman realizes that the “free” version will be sufficient for a large portion of the HPC market. That include some of the biggest single-system deployments, such as the Ranger supercomputer at the Texas Advanced Computing Center and the TSUBAME machine at the Tokyo Institute of Technology. But in general, the industry is moving toward a two-tiered model with regard to open source. Just as Platform LSF and PBS Pro have their open source counterparts in Platform Lava and OpenPBS/Torque, respectively, Univa believes that there is plenty of demand for a commercial Grid Engine offering.

According to Tyreman, there are probably 4 million-plus CPUs spread out across more than 1,000 organizations running Grid Engine today. Univa only needs a fraction of that market to make a commercial product economically viable. Businesses with high-value applications such as electronic design automation (EDA), manufacturing design, and financial analytics would be among those most interested in a shrink-wrapped premium offering.

Like other commercial workload schedulers, Univa’s Grid Engine will be licensed on a per-core, per-term basis. In general, Tyreman expects licensing costs to be aligned with traditional Grid Engine-based products, and to be very competitive with rival management products.

The real balancing act for Univa will be to differentiate their own product, while keeping the open source base viable for the larger community upon which they depend. Although the value-add product that Univa plans to license will certainly be for technical computing customers looking for extra features and functionality, what exact shape that will take remains to be seen. With the advent of enterprise cloud computing, and Univa’s own interest in that space (although lately the company has been shying away from the cloud terminology), it’s likely that they will evolve their product to serve a broader set of customers than just HPC users. Workload scheduling is one thing in a 100-node HPC cluster, and quite another in a datacenter with thousands of servers running mission critical applications.

Grid Engine end users and companies are probably breathing a little easier now that the software is back in the hands of a genuine HPC vendor that understands the ecosystem. After its Oracle detour, the Grid Engine roadmap appears to be returning to the one established by its founders. Says Tyreman: “We are going to continue on a path that was already set 10 years ago.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Data Vortex Users Contemplate the Future of Supercomputing

October 19, 2017

Last month (Sept. 11-12), HPC networking company Data Vortex held its inaugural users group at Pacific Northwest National Laboratory (PNNL) bringing together about 30 participants from industry, government and academia t Read more…

By Tiffany Trader

AI Self-Training Goes Forward at Google DeepMind

October 19, 2017

DeepMind, Google’s AI research organization, announced today in a blog that AlphaGo Zero, the latest evolution of AlphaGo (the first computer program to defeat a Go world champion) trained itself within three days to play Go at a superhuman level (i.e., better than any human) – and to beat the old version of AlphaGo – without leveraging human expertise, data or training. Read more…

By Doug Black

Researchers Scale COSMO Climate Code to 4888 GPUs on Piz Daint

October 17, 2017

Effective global climate simulation, sorely needed to anticipate and cope with global warming, has long been computationally challenging. Two of the major obstacles are the needed resolution and prolonged time to compute Read more…

By John Russell

HPE Extreme Performance Solutions

Transforming Genomic Analytics with HPC-Accelerated Insights

Advancements in the field of genomics are revolutionizing our understanding of human biology, rapidly accelerating the discovery and treatment of genetic diseases, and dramatically improving human health. Read more…

Student Cluster Competition Coverage New Home

October 16, 2017

Hello computer sports fans! This is the first of many (many!) articles covering the world-wide phenomenon of Student Cluster Competitions. Finally, the Student Cluster Competition coverage has come to its natural home: H Read more…

By Dan Olds

Data Vortex Users Contemplate the Future of Supercomputing

October 19, 2017

Last month (Sept. 11-12), HPC networking company Data Vortex held its inaugural users group at Pacific Northwest National Laboratory (PNNL) bringing together ab Read more…

By Tiffany Trader

AI Self-Training Goes Forward at Google DeepMind

October 19, 2017

DeepMind, Google’s AI research organization, announced today in a blog that AlphaGo Zero, the latest evolution of AlphaGo (the first computer program to defeat a Go world champion) trained itself within three days to play Go at a superhuman level (i.e., better than any human) – and to beat the old version of AlphaGo – without leveraging human expertise, data or training. Read more…

By Doug Black

Student Cluster Competition Coverage New Home

October 16, 2017

Hello computer sports fans! This is the first of many (many!) articles covering the world-wide phenomenon of Student Cluster Competitions. Finally, the Student Read more…

By Dan Olds

Intel Delivers 17-Qubit Quantum Chip to European Research Partner

October 10, 2017

On Tuesday, Intel delivered a 17-qubit superconducting test chip to research partner QuTech, the quantum research institute of Delft University of Technology (TU Delft) in the Netherlands. The announcement marks a major milestone in the 10-year, $50-million collaborative relationship with TU Delft and TNO, the Dutch Organization for Applied Research, to accelerate advancements in quantum computing. Read more…

By Tiffany Trader

Fujitsu Tapped to Build 37-Petaflops ABCI System for AIST

October 10, 2017

Fujitsu announced today it will build the long-planned AI Bridging Cloud Infrastructure (ABCI) which is set to become the fastest supercomputer system in Japan Read more…

By John Russell

HPC Chips – A Veritable Smorgasbord?

October 10, 2017

For the first time since AMD's ill-fated launch of Bulldozer the answer to the question, 'Which CPU will be in my next HPC system?' doesn't have to be 'Whichever variety of Intel Xeon E5 they are selling when we procure'. Read more…

By Dairsie Latimer

Delays, Smoke, Records & Markets – A Candid Conversation with Cray CEO Peter Ungaro

October 5, 2017

Earlier this month, Tom Tabor, publisher of HPCwire and I had a very personal conversation with Cray CEO Peter Ungaro. Cray has been on something of a Cinderell Read more…

By Tiffany Trader & Tom Tabor

Intel Debuts Programmable Acceleration Card

October 5, 2017

With a view toward supporting complex, data-intensive applications, such as AI inference, video streaming analytics, database acceleration and genomics, Intel i Read more…

By Doug Black

Reinders: “AVX-512 May Be a Hidden Gem” in Intel Xeon Scalable Processors

June 29, 2017

Imagine if we could use vector processing on something other than just floating point problems.  Today, GPUs and CPUs work tirelessly to accelerate algorithms Read more…

By James Reinders

NERSC Scales Scientific Deep Learning to 15 Petaflops

August 28, 2017

A collaborative effort between Intel, NERSC and Stanford has delivered the first 15-petaflops deep learning software running on HPC platforms and is, according Read more…

By Rob Farber

Oracle Layoffs Reportedly Hit SPARC and Solaris Hard

September 7, 2017

Oracle’s latest layoffs have many wondering if this is the end of the line for the SPARC processor and Solaris OS development. As reported by multiple sources Read more…

By John Russell

US Coalesces Plans for First Exascale Supercomputer: Aurora in 2021

September 27, 2017

At the Advanced Scientific Computing Advisory Committee (ASCAC) meeting, in Arlington, Va., yesterday (Sept. 26), it was revealed that the "Aurora" supercompute Read more…

By Tiffany Trader

How ‘Knights Mill’ Gets Its Deep Learning Flops

June 22, 2017

Intel, the subject of much speculation regarding the delayed, rewritten or potentially canceled “Aurora” contract (the Argonne Lab part of the CORAL “ Read more…

By Tiffany Trader

Google Releases Deeplearn.js to Further Democratize Machine Learning

August 17, 2017

Spreading the use of machine learning tools is one of the goals of Google’s PAIR (People + AI Research) initiative, which was introduced in early July. Last w Read more…

By John Russell

GlobalFoundries Puts Wind in AMD’s Sails with 12nm FinFET

September 24, 2017

From its annual tech conference last week (Sept. 20), where GlobalFoundries welcomed more than 600 semiconductor professionals (reaching the Santa Clara venue Read more…

By Tiffany Trader

Graphcore Readies Launch of 16nm Colossus-IPU Chip

July 20, 2017

A second $30 million funding round for U.K. AI chip developer Graphcore sets up the company to go to market with its “intelligent processing unit” (IPU) in Read more…

By Tiffany Trader

Leading Solution Providers

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Amazon Debuts New AMD-based GPU Instances for Graphics Acceleration

September 12, 2017

Last week Amazon Web Services (AWS) streaming service, AppStream 2.0, introduced a new GPU instance called Graphics Design intended to accelerate graphics. The Read more…

By John Russell

EU Funds 20 Million Euro ARM+FPGA Exascale Project

September 7, 2017

At the Barcelona Supercomputer Centre on Wednesday (Sept. 6), 16 partners gathered to launch the EuroEXA project, which invests €20 million over three-and-a-half years into exascale-focused research and development. Led by the Horizon 2020 program, EuroEXA picks up the banner of a triad of partner projects — ExaNeSt, EcoScale and ExaNoDe — building on their work... Read more…

By Tiffany Trader

Delays, Smoke, Records & Markets – A Candid Conversation with Cray CEO Peter Ungaro

October 5, 2017

Earlier this month, Tom Tabor, publisher of HPCwire and I had a very personal conversation with Cray CEO Peter Ungaro. Cray has been on something of a Cinderell Read more…

By Tiffany Trader & Tom Tabor

Cray Moves to Acquire the Seagate ClusterStor Line

July 28, 2017

This week Cray announced that it is picking up Seagate's ClusterStor HPC storage array business for an undisclosed sum. "In short we're effectively transitioning the bulk of the ClusterStor product line to Cray," said CEO Peter Ungaro. Read more…

By Tiffany Trader

Intel Launches Software Tools to Ease FPGA Programming

September 5, 2017

Field Programmable Gate Arrays (FPGAs) have a reputation for being difficult to program, requiring expertise in specialty languages, like Verilog or VHDL. Easin Read more…

By Tiffany Trader

IBM Advances Web-based Quantum Programming

September 5, 2017

IBM Research is pairing its Jupyter-based Data Science Experience notebook environment with its cloud-based quantum computer, IBM Q, in hopes of encouraging a new class of entrepreneurial user to solve intractable problems that even exceed the capabilities of the best AI systems. Read more…

By Alex Woodie

HPC Chips – A Veritable Smorgasbord?

October 10, 2017

For the first time since AMD's ill-fated launch of Bulldozer the answer to the question, 'Which CPU will be in my next HPC system?' doesn't have to be 'Whichever variety of Intel Xeon E5 they are selling when we procure'. Read more…

By Dairsie Latimer

  • arrow
  • Click Here for More Headlines
  • arrow
Share This