Database Vendor Versant Eyes HPC Market

By John West

September 29, 2009

Object database maker Versant has done pretty well in its market niche, with a list of 1,500 customers that includes well-known names like AT&T, Alcatel-Lucent, Ericsson, and British Airways. With 80 people, a market cap of $65 million USD, and revenue last year of $25 million, Versant is a small company by most any measure. But it is in a small industry: while the relational database business is valued around $10 billion a year these days, the object database market is on the order of only a couple hundred million dollars a year.

A niche product for a niche market, Versant’s core technology isn’t needed everywhere, but it is indispensable where it is needed. And the company is hoping to demonstrate that at least some HPC users need it.

Alright, first things first: what’s an object database? Object databases provide persistent storage for, well, objects. Imagine you have a backpack object, and that backpack has a flashlight object and a rope object in it. When you retrieve the backpack object out of the database you get the flashlight and the rope along with it, no extra queries required (well, actually you probably get pointers to those objects, but that’s a detail).

With a relational database, data is stored in rows and columns in (probably many) tables in your database. In our backpack example all backpacks may be listed in a specific table, with each given a unique ID. Another table may store the various camp tools, like ropes and flashlights, that campers may put in backpacks. And yet a third table would put these together, with one row holding the ID for our backpack and the flashlight, and another row holding the ID for our backpack again and the rope.

The mechanics of retrieval offer an important distinction with the relational model: unlike a relational database wherein programmers have to structure a database request (query) in a separate language called SQL, an object database works in the context of a regular programming language such as C++, C or Java. So, for the object database, a programmer calls the backpack object into memory and it comes along with (pointers to) the flashlight and rope objects. But a programmer using a relational database would constructuct a SQL query that first pulled all of the records from the third table to find all the entries that are associated with our backpack’s ID. Then he’d have to construct other queries to look in the camp tool tables to find out what kinds of tools were attached to those IDs.

Despite the apparent added headaches of working with SQL and a relational database, they can be very (very) fast in a wide variety of applications, and have been proven to scale to enormous sizes. They are ubiquitous in nearly every enterprise, and you probably have a bunch in your own HPC center for managing inventory, user tickets, and so on. On the other hand, there are well-documented situations in which object databases are not only easier for a developer to deal with, they are much faster than the alternatives.

“Complexity and concurrency are the two things that we look for in application profiles that would lend themselves well to an object-oriented database,” says David Ingersoll, Versant’s VP of sales (Americas and APAC).

Of course, in traditional high performance technical computing, the choices aren’t between relational and object databases. The choices are between using any kind of database at all and flat files. And Ingersoll acknowledges this is a key obstacle they face in talking with clients, “One challenge is just to get people to realize that they need a database and not just a filesystem.”

But he isn’t coming to HPC empty-handed. When he briefed us about Versant’s potential in the HPC space, Ingersoll talked about examples of traditional HPC users using Versant’s object databases in HPC applications today; particularly, applications with large streaming data. For example, the Air Force Weather Agency uses a Versant database to store real-time satellite imagery that is then fed into computational models for cloud forecasts. Other similar applications include the European Space Agency’s Herschel Space Observatory, where Versant is the mission database, and Verizon, where real-time call data are streamed into a hierarchical set of databases that are used for near real-time fraud detection.

Exxon Mobil is also using Versant’s technology in its reservoir simulation system, EMPower. In its application, results from large-scale numerical simulations are stored in the database and then subjected to analytics routines that answer questions about where to place wells, when and where to inject fluids, and so forth.

In many of their HPC examples, Versant’s users are storing the data in a large database that itself may be hosted on a cluster. Hundreds or thousands of clients then access the database from the compute nodes of other clusters to process the data and answer mission questions. This is a basic level of parallelism supported by Versant, which also offers multi-threaded and parallel queries baked into the database engine along with a dual cache and object-locking for high concurrency support.

Object databases themselves aren’t new: work started on them in the 1980s and spiked in the early 1990s when all the cool kids were drinking the O-O Kool-Aid. As object-oriented languages have become mainstream (including C++, Java, and C#), programmers have struggled with mapping their languages to relational databases because they wanted to work with what they knew: familiar languages and familiar (relational) databases.

And this points to a key challenge in positioning an object database technology for HPC: if you aren’t using an object-oriented language, you aren’t going to see much benefit. “C and FORTRAN don’t lend themselves well [to object databases] because the domain models are very flat, very procedurally oriented, and they’re not going to have a lot of inter-relationships,” says Ingersoll. “At that point, the benefit of our system really falls down.”

Versant is targeting markets and applications where C++ and Java are already in use for intensive computing, or where the practictioners don’t have a vast store of legacy code in their toolboxes already. Areas like bioinformatics offer a lot of potential, not only because of the very modern nature of many of those codes, but also because the domain data model is inherently object-oriented. According to Ingersoll, “We are at that point where people are just coming [into HPC in these domains], so if we can get in front of that wave then that’s a benefit for us.”

Versant is looking to build partnerships as it tries to wriggle into the HPC market. Ingersoll let us know that they are talking to both Penguin Computing and Panasas about working more closely together. The Panasas opportunity seems particularly appropos given the object-based nature of Panasas’ PanFS file system. In fact, according to Ingersoll, Versant is already being used in the financial services industry on a cluster outfitted with Panasas storage.

Versant doesn’t have the object database market to itself, of course. It competes with companies like Objectivity and Intersystems in the object database market, and with Microsoft and Oracle, both of which have a growing interest in the technology. Object databases are an interesting technology, and in twenty years of development Versant has structured a robust solution. But getting databases into HPC, even into the developing segments of our community, will be a tall order. Differentiating object databases from relational databases to HPC people layers another challenge on top of that.

This is a challenge that Ingersoll feels Versant is equal to, “We are getting the market to understand that difference,” he says. “If people are investigating what steps to take today, we have a much better shot at educating them than if they are going to be moving that application from C to C++, and you’re really going to be thoughtful about how you’re modeling the application, then we provide orders of magnitude of performance benefits.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

HPE Launches Apollo 6500 Gen10 System as Part of AI Solution Push

March 21, 2018

HPE today announced the latest rev of its HPE Apollo 6500 platform, Gen10, along with a spate of new AI-oriented offerings designed to help customers optimize and scale up their AI and deep learning usage. Like is Gen Read more…

By Tiffany Trader

IBM Touts OpenPOWER Ecosystem, Announces New Customers, Products for AI and Hyperscale

March 20, 2018

At SC17 in Denver four months ago, Ken King, GM, OpenPOWER, IBM Systems Group, told a somewhat jaundiced trio of journalists that 2018 would, finally, after several years of expectations, be the year OpenPOWER and IBM’ Read more…

By Doug Black

Deep Learning at 15 PFlops Enables Training for Extreme Weather Identification at Scale

March 19, 2018

Petaflop per second deep learning training performance on the NERSC (National Energy Research Scientific Computing Center) Cori supercomputer has given climate scientists the ability to use machine learning to identify e Read more…

By Rob Farber

HPE Extreme Performance Solutions

Harness the Full Power of HPC Servers with an Effective Cooling Approach

High performance computing (HPC) innovation is rapidly transforming the way we operate – with an onslaught of cutting-edge technologies designed to optimize applications and workloads, increase productivity, and enable better business outcomes. Read more…

IBM Unveils New Cloud for Data Science and Engineering

March 19, 2018

Days ahead of its inaugural IBM Think mega-event, the multinational tech mainstay on Friday (March 16) unveiled a new cloud offering called Cloud Private Data that’s designed to help organizations utilize data science Read more…

By Alex Woodie

HPE Launches Apollo 6500 Gen10 System as Part of AI Solution Push

March 21, 2018

HPE today announced the latest rev of its HPE Apollo 6500 platform, Gen10, along with a spate of new AI-oriented offerings designed to help customers optimize a Read more…

By Tiffany Trader

IBM Touts OpenPOWER Ecosystem, Announces New Customers, Products for AI and Hyperscale

March 20, 2018

At SC17 in Denver four months ago, Ken King, GM, OpenPOWER, IBM Systems Group, told a somewhat jaundiced trio of journalists that 2018 would, finally, after sev Read more…

By Doug Black

Deep Learning at 15 PFlops Enables Training for Extreme Weather Identification at Scale

March 19, 2018

Petaflop per second deep learning training performance on the NERSC (National Energy Research Scientific Computing Center) Cori supercomputer has given climate Read more…

By Rob Farber

How the Cloud Is Falling Short for HPC

March 15, 2018

The last couple of years have seen cloud computing gradually build some legitimacy within the HPC world, but still the HPC industry lies far behind enterprise I Read more…

By Chris Downing

Stephen Hawking, Legendary Scientist, Dies at 76

March 14, 2018

Stephen Hawking passed away at his home in Cambridge, England, in the early morning of March 14; he was 76. Born on January 8, 1942, Hawking was an English theo Read more…

By Tiffany Trader

Hyperion Tackles Elusive Quantum Computing Landscape

March 13, 2018

Quantum computing - exciting and off-putting all at once - is a kaleidoscope of technology and market questions whose shapes and positions are far from settled. Read more…

By John Russell

Part Two: Navigating Life Sciences Choppy HPC Waters in 2018

March 8, 2018

2017 was not necessarily the best year to build a large HPC system for life sciences say Ari Berman, VP and GM of consulting services, and Aaron Gardner, direct Read more…

By John Russell

Google Chases Quantum Supremacy with 72-Qubit Processor

March 7, 2018

Google pulled ahead of the pack this week in the race toward "quantum supremacy," with the introduction of a new 72-qubit quantum processor called Bristlecone. Read more…

By Tiffany Trader

Inventor Claims to Have Solved Floating Point Error Problem

January 17, 2018

"The decades-old floating point error problem has been solved," proclaims a press release from inventor Alan Jorgensen. The computer scientist has filed for and Read more…

By Tiffany Trader

Japan Unveils Quantum Neural Network

November 22, 2017

The U.S. and China are leading the race toward productive quantum computing, but it's early enough that ultimate leadership is still something of an open questi Read more…

By Tiffany Trader

Researchers Measure Impact of ‘Meltdown’ and ‘Spectre’ Patches on HPC Workloads

January 17, 2018

Computer scientists from the Center for Computational Research, State University of New York (SUNY), University at Buffalo have examined the effect of Meltdown Read more…

By Tiffany Trader

IBM Begins Power9 Rollout with Backing from DOE, Google

December 6, 2017

After over a year of buildup, IBM is unveiling its first Power9 system based on the same architecture as the Department of Energy CORAL supercomputers, Summit a Read more…

By Tiffany Trader

Fast Forward: Five HPC Predictions for 2018

December 21, 2017

What’s on your list of high (and low) lights for 2017? Volta 100’s arrival on the heels of the P100? Appearance, albeit late in the year, of IBM’s Power9? Read more…

By John Russell

Russian Nuclear Engineers Caught Cryptomining on Lab Supercomputer

February 12, 2018

Nuclear scientists working at the All-Russian Research Institute of Experimental Physics (RFNC-VNIIEF) have been arrested for using lab supercomputing resources to mine crypto-currency, according to a report in Russia’s Interfax News Agency. Read more…

By Tiffany Trader

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Chip Flaws ‘Meltdown’ and ‘Spectre’ Loom Large

January 4, 2018

The HPC and wider tech community have been abuzz this week over the discovery of critical design flaws that impact virtually all contemporary microprocessors. T Read more…

By Tiffany Trader

Leading Solution Providers

GlobalFoundries, Ayar Labs Team Up to Commercialize Optical I/O

December 4, 2017

GlobalFoundries (GF) and Ayar Labs, a startup focused on using light, instead of electricity, to transfer data between chips, today announced they've entered in Read more…

By Tiffany Trader

How Meltdown and Spectre Patches Will Affect HPC Workloads

January 10, 2018

There have been claims that the fixes for the Meltdown and Spectre security vulnerabilities, named the KPTI (aka KAISER) patches, are going to affect applicatio Read more…

By Rosemary Francis

Perspective: What Really Happened at SC17?

November 22, 2017

SC is over. Now comes the myriad of follow-ups. Inboxes are filled with templated emails from vendors and other exhibitors hoping to win a place in the post-SC thinking of booth visitors. Attendees of tutorials, workshops and other technical sessions will be inundated with requests for feedback. Read more…

By Andrew Jones

V100 Good but not Great on Select Deep Learning Aps, Says Xcelerit

November 27, 2017

Wringing optimum performance from hardware to accelerate deep learning applications is a challenge that often depends on the specific application in use. A benc Read more…

By John Russell

Lenovo Unveils Warm Water Cooled ThinkSystem SD650 in Rampup to LRZ Install

February 22, 2018

This week Lenovo took the wraps off the ThinkSystem SD650 high-density server with third-generation direct water cooling technology developed in tandem with par Read more…

By Tiffany Trader

AMD Wins Another: Baidu to Deploy EPYC on Single Socket Servers

December 13, 2017

When AMD introduced its EPYC chip line in June, the company said a portion of the line was specifically designed to re-invigorate a single socket segment in wha Read more…

By John Russell

World Record: Quantum Computer with 46 Qubits Simulated

December 18, 2017

Scientists from the Jülich Supercomputing Centre have set a new world record. Together with researchers from Wuhan University and the University of Groningen, Read more…

New Blueprint for Converging HPC, Big Data

January 18, 2018

After five annual workshops on Big Data and Extreme-Scale Computing (BDEC), a group of international HPC heavyweights including Jack Dongarra (University of Te Read more…

By John Russell

  • arrow
  • Click Here for More Headlines
  • arrow
Share This