Database Vendor Versant Eyes HPC Market

By John West

September 29, 2009

Object database maker Versant has done pretty well in its market niche, with a list of 1,500 customers that includes well-known names like AT&T, Alcatel-Lucent, Ericsson, and British Airways. With 80 people, a market cap of $65 million USD, and revenue last year of $25 million, Versant is a small company by most any measure. But it is in a small industry: while the relational database business is valued around $10 billion a year these days, the object database market is on the order of only a couple hundred million dollars a year.

A niche product for a niche market, Versant’s core technology isn’t needed everywhere, but it is indispensable where it is needed. And the company is hoping to demonstrate that at least some HPC users need it.

Alright, first things first: what’s an object database? Object databases provide persistent storage for, well, objects. Imagine you have a backpack object, and that backpack has a flashlight object and a rope object in it. When you retrieve the backpack object out of the database you get the flashlight and the rope along with it, no extra queries required (well, actually you probably get pointers to those objects, but that’s a detail).

With a relational database, data is stored in rows and columns in (probably many) tables in your database. In our backpack example all backpacks may be listed in a specific table, with each given a unique ID. Another table may store the various camp tools, like ropes and flashlights, that campers may put in backpacks. And yet a third table would put these together, with one row holding the ID for our backpack and the flashlight, and another row holding the ID for our backpack again and the rope.

The mechanics of retrieval offer an important distinction with the relational model: unlike a relational database wherein programmers have to structure a database request (query) in a separate language called SQL, an object database works in the context of a regular programming language such as C++, C or Java. So, for the object database, a programmer calls the backpack object into memory and it comes along with (pointers to) the flashlight and rope objects. But a programmer using a relational database would constructuct a SQL query that first pulled all of the records from the third table to find all the entries that are associated with our backpack’s ID. Then he’d have to construct other queries to look in the camp tool tables to find out what kinds of tools were attached to those IDs.

Despite the apparent added headaches of working with SQL and a relational database, they can be very (very) fast in a wide variety of applications, and have been proven to scale to enormous sizes. They are ubiquitous in nearly every enterprise, and you probably have a bunch in your own HPC center for managing inventory, user tickets, and so on. On the other hand, there are well-documented situations in which object databases are not only easier for a developer to deal with, they are much faster than the alternatives.

“Complexity and concurrency are the two things that we look for in application profiles that would lend themselves well to an object-oriented database,” says David Ingersoll, Versant’s VP of sales (Americas and APAC).

Of course, in traditional high performance technical computing, the choices aren’t between relational and object databases. The choices are between using any kind of database at all and flat files. And Ingersoll acknowledges this is a key obstacle they face in talking with clients, “One challenge is just to get people to realize that they need a database and not just a filesystem.”

But he isn’t coming to HPC empty-handed. When he briefed us about Versant’s potential in the HPC space, Ingersoll talked about examples of traditional HPC users using Versant’s object databases in HPC applications today; particularly, applications with large streaming data. For example, the Air Force Weather Agency uses a Versant database to store real-time satellite imagery that is then fed into computational models for cloud forecasts. Other similar applications include the European Space Agency’s Herschel Space Observatory, where Versant is the mission database, and Verizon, where real-time call data are streamed into a hierarchical set of databases that are used for near real-time fraud detection.

Exxon Mobil is also using Versant’s technology in its reservoir simulation system, EMPower. In its application, results from large-scale numerical simulations are stored in the database and then subjected to analytics routines that answer questions about where to place wells, when and where to inject fluids, and so forth.

In many of their HPC examples, Versant’s users are storing the data in a large database that itself may be hosted on a cluster. Hundreds or thousands of clients then access the database from the compute nodes of other clusters to process the data and answer mission questions. This is a basic level of parallelism supported by Versant, which also offers multi-threaded and parallel queries baked into the database engine along with a dual cache and object-locking for high concurrency support.

Object databases themselves aren’t new: work started on them in the 1980s and spiked in the early 1990s when all the cool kids were drinking the O-O Kool-Aid. As object-oriented languages have become mainstream (including C++, Java, and C#), programmers have struggled with mapping their languages to relational databases because they wanted to work with what they knew: familiar languages and familiar (relational) databases.

And this points to a key challenge in positioning an object database technology for HPC: if you aren’t using an object-oriented language, you aren’t going to see much benefit. “C and FORTRAN don’t lend themselves well [to object databases] because the domain models are very flat, very procedurally oriented, and they’re not going to have a lot of inter-relationships,” says Ingersoll. “At that point, the benefit of our system really falls down.”

Versant is targeting markets and applications where C++ and Java are already in use for intensive computing, or where the practictioners don’t have a vast store of legacy code in their toolboxes already. Areas like bioinformatics offer a lot of potential, not only because of the very modern nature of many of those codes, but also because the domain data model is inherently object-oriented. According to Ingersoll, “We are at that point where people are just coming [into HPC in these domains], so if we can get in front of that wave then that’s a benefit for us.”

Versant is looking to build partnerships as it tries to wriggle into the HPC market. Ingersoll let us know that they are talking to both Penguin Computing and Panasas about working more closely together. The Panasas opportunity seems particularly appropos given the object-based nature of Panasas’ PanFS file system. In fact, according to Ingersoll, Versant is already being used in the financial services industry on a cluster outfitted with Panasas storage.

Versant doesn’t have the object database market to itself, of course. It competes with companies like Objectivity and Intersystems in the object database market, and with Microsoft and Oracle, both of which have a growing interest in the technology. Object databases are an interesting technology, and in twenty years of development Versant has structured a robust solution. But getting databases into HPC, even into the developing segments of our community, will be a tall order. Differentiating object databases from relational databases to HPC people layers another challenge on top of that.

This is a challenge that Ingersoll feels Versant is equal to, “We are getting the market to understand that difference,” he says. “If people are investigating what steps to take today, we have a much better shot at educating them than if they are going to be moving that application from C to C++, and you’re really going to be thoughtful about how you’re modeling the application, then we provide orders of magnitude of performance benefits.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

AMD Charges Back into the Datacenter and HPC Workflows with EPYC Processor

June 20, 2017

AMD is charging back into the enterprise datacenter and select HPC workflows with its new EPYC 7000 processor line, code-named Naples, announced today at a “global” launch event in Austin TX. In many ways it was a fu Read more…

By John Russell

Hyperion: Deep Learning, AI Helping Drive Healthy HPC Industry Growth

June 20, 2017

To be at the ISC conference in Frankfurt this week is to experience deep immersion in deep learning. Users want to learn about it, vendors want to talk about it, analysts and journalists want to report on it. Deep learni Read more…

By Doug Black

OpenACC Shows Growing Strength at ISC

June 19, 2017

OpenACC is strutting its stuff at ISC this year touting expanding membership, a jump in downloads, favorable benchmarks across several architectures, new staff members, and new support by key HPC applications providers, Read more…

By John Russell

Top500 Results: Latest List Trends and What’s in Store

June 19, 2017

Greetings from Frankfurt and the 2017 International Supercomputing Conference where the latest Top500 list has just been revealed. Although there were no major shakeups -- China still has the top two spots locked with th Read more…

By Tiffany Trader

HPE Extreme Performance Solutions

Creating a Roadmap for HPC Innovation at ISC 2017

In an era where technological advancements are driving innovation to every sector, and powering major economic and scientific breakthroughs, high performance computing (HPC) is crucial to tackle the challenges of today and tomorrow. Read more…

ISC: Extreme-Scale Requirements to Push the Frontiers of Deep Learning

June 17, 2017

Deep learning is the latest and most compelling technology strategy to take aim at the decades-old “drowning in data/starving for insight” problem. But contrary to the commonly held notion, deep learning is more than Read more…

By Doug Black

Six Exascale PathForward Vendors Selected; DoE Providing $258M

June 15, 2017

The much-anticipated PathForward awards for hardware R&D in support of the Exascale Computing Project were announced today with six vendors selected – AMD, Cray, Hewlett Packard Enterprise (HPE), IBM, Intel, and NV Read more…

By John Russell

OpenSuCo: Advancing Open Source Supercomputing at ISC

June 15, 2017

As open source hardware gains traction, the potential for a completely open source supercomputing system becomes a compelling proposition, one that is being investigated by the International Workshop on Open Source Super Read more…

By Tiffany Trader

Mellanox Raises SHIELD for Enhanced Network Resiliency

June 15, 2017

High-performance networking company Mellanox is announcing a new protocol it’s calling SHIELD, an acronym for “Self Healing Interconnect Enhancement for inteLligent Datacenters.” Enabled within Mellanox’s 100G ED Read more…

By Tiffany Trader

AMD Charges Back into the Datacenter and HPC Workflows with EPYC Processor

June 20, 2017

AMD is charging back into the enterprise datacenter and select HPC workflows with its new EPYC 7000 processor line, code-named Naples, announced today at a “g Read more…

By John Russell

Hyperion: Deep Learning, AI Helping Drive Healthy HPC Industry Growth

June 20, 2017

To be at the ISC conference in Frankfurt this week is to experience deep immersion in deep learning. Users want to learn about it, vendors want to talk about it Read more…

By Doug Black

OpenACC Shows Growing Strength at ISC

June 19, 2017

OpenACC is strutting its stuff at ISC this year touting expanding membership, a jump in downloads, favorable benchmarks across several architectures, new staff Read more…

By John Russell

Top500 Results: Latest List Trends and What’s in Store

June 19, 2017

Greetings from Frankfurt and the 2017 International Supercomputing Conference where the latest Top500 list has just been revealed. Although there were no major Read more…

By Tiffany Trader

ISC: Extreme-Scale Requirements to Push the Frontiers of Deep Learning

June 17, 2017

Deep learning is the latest and most compelling technology strategy to take aim at the decades-old “drowning in data/starving for insight” problem. But cont Read more…

By Doug Black

Six Exascale PathForward Vendors Selected; DoE Providing $258M

June 15, 2017

The much-anticipated PathForward awards for hardware R&D in support of the Exascale Computing Project were announced today with six vendors selected – AMD Read more…

By John Russell

OpenSuCo: Advancing Open Source Supercomputing at ISC

June 15, 2017

As open source hardware gains traction, the potential for a completely open source supercomputing system becomes a compelling proposition, one that is being inv Read more…

By Tiffany Trader

Mellanox Raises SHIELD for Enhanced Network Resiliency

June 15, 2017

High-performance networking company Mellanox is announcing a new protocol it’s calling SHIELD, an acronym for “Self Healing Interconnect Enhancement for int Read more…

By Tiffany Trader

Quantum Bits: D-Wave and VW; Google Quantum Lab; IBM Expands Access

March 21, 2017

For a technology that’s usually characterized as far off and in a distant galaxy, quantum computing has been steadily picking up steam. Just how close real-wo Read more…

By John Russell

Trump Budget Targets NIH, DOE, and EPA; No Mention of NSF

March 16, 2017

President Trump’s proposed U.S. fiscal 2018 budget issued today sharply cuts science spending while bolstering military spending as he promised during the cam Read more…

By John Russell

HPC Compiler Company PathScale Seeks Life Raft

March 23, 2017

HPCwire has learned that HPC compiler company PathScale has fallen on difficult times and is asking the community for help or actively seeking a buyer for its a Read more…

By Tiffany Trader

Google Pulls Back the Covers on Its First Machine Learning Chip

April 6, 2017

This week Google released a report detailing the design and performance characteristics of the Tensor Processing Unit (TPU), its custom ASIC for the inference Read more…

By Tiffany Trader

CPU-based Visualization Positions for Exascale Supercomputing

March 16, 2017

In this contributed perspective piece, Intel’s Jim Jeffers makes the case that CPU-based visualization is now widely adopted and as such is no longer a contrarian view, but is rather an exascale requirement. Read more…

By Jim Jeffers, Principal Engineer and Engineering Leader, Intel

Nvidia Responds to Google TPU Benchmarking

April 10, 2017

Nvidia highlights strengths of its newest GPU silicon in response to Google's report on the performance and energy advantages of its custom tensor processor. Read more…

By Tiffany Trader

Nvidia’s Mammoth Volta GPU Aims High for AI, HPC

May 10, 2017

At Nvidia's GPU Technology Conference (GTC17) in San Jose, Calif., this morning, CEO Jensen Huang announced the company's much-anticipated Volta architecture a Read more…

By Tiffany Trader

Facebook Open Sources Caffe2; Nvidia, Intel Rush to Optimize

April 18, 2017

From its F8 developer conference in San Jose, Calif., today, Facebook announced Caffe2, a new open-source, cross-platform framework for deep learning. Caffe2 is the successor to Caffe, the deep learning framework developed by Berkeley AI Research and community contributors. Read more…

By Tiffany Trader

Leading Solution Providers

MIT Mathematician Spins Up 220,000-Core Google Compute Cluster

April 21, 2017

On Thursday, Google announced that MIT math professor and computational number theorist Andrew V. Sutherland had set a record for the largest Google Compute Engine (GCE) job. Sutherland ran the massive mathematics workload on 220,000 GCE cores using preemptible virtual machine instances. Read more…

By Tiffany Trader

Google Debuts TPU v2 and will Add to Google Cloud

May 25, 2017

Not long after stirring attention in the deep learning/AI community by revealing the details of its Tensor Processing Unit (TPU), Google last week announced the Read more…

By John Russell

US Supercomputing Leaders Tackle the China Question

March 15, 2017

Joint DOE-NSA report responds to the increased global pressures impacting the competitiveness of U.S. supercomputing. Read more…

By Tiffany Trader

Groq This: New AI Chips to Give GPUs a Run for Deep Learning Money

April 24, 2017

CPUs and GPUs, move over. Thanks to recent revelations surrounding Google’s new Tensor Processing Unit (TPU), the computing world appears to be on the cusp of Read more…

By Alex Woodie

Russian Researchers Claim First Quantum-Safe Blockchain

May 25, 2017

The Russian Quantum Center today announced it has overcome the threat of quantum cryptography by creating the first quantum-safe blockchain, securing cryptocurrencies like Bitcoin, along with classified government communications and other sensitive digital transfers. Read more…

By Doug Black

DOE Supercomputer Achieves Record 45-Qubit Quantum Simulation

April 13, 2017

In order to simulate larger and larger quantum systems and usher in an age of “quantum supremacy,” researchers are stretching the limits of today’s most advanced supercomputers. Read more…

By Tiffany Trader

Messina Update: The US Path to Exascale in 16 Slides

April 26, 2017

Paul Messina, director of the U.S. Exascale Computing Project, provided a wide-ranging review of ECP’s evolving plans last week at the HPC User Forum. Read more…

By John Russell

Knights Landing Processor with Omni-Path Makes Cloud Debut

April 18, 2017

HPC cloud specialist Rescale is partnering with Intel and HPC resource provider R Systems to offer first-ever cloud access to Xeon Phi "Knights Landing" processors. The infrastructure is based on the 68-core Intel Knights Landing processor with integrated Omni-Path fabric (the 7250F Xeon Phi). Read more…

By Tiffany Trader

  • arrow
  • Click Here for More Headlines
  • arrow
Share This