GemStone EVP on Maximizing Grid, SOA Deployments

By Nicole Hemsoth

August 7, 2006

In this Q&A with GRIDtoday, GemStone Systems executive vice president of marketing and strategy Shankar Iyer discusses his company's Enterprise Data Fabric (EDF). Iyer explains where EDF fits into today's modern architectures (Grid, cluster, SOA, etc.), as well as in what markets the company sees the strongest demand and the most potential for the solution.



GRIDtoday:
First, can you give me your definition of an Enterprise Data Fabric?

SHANKAR IYER: An Enterprise Data Fabric (EDF) is a distributed, operational data layer that serves as a foundational information infrastructure for the demanding needs of modern day architectures such as SOA, Grid/cluster computing and OLTP applications. Envision an EDF as an active data network which harnesses memory and disk across several hundreds or even thousands of distributed nodes to store, distribute and analyze data and deliver it to any application in a fast, consistent and reliable manner. An EDF holds the relevant “operational data subset” required for a specific workflow, transaction or computation close to the point of use, enabling highly responsive, information-driven applications across a distributed network.

Gt: How does an EDF complement distributed technologies like Grid computing and SOA?

IYER: SOA and Grid computing initiatives often present significant data management challenges. These are distributed deployments that require data from multiple sources to be provisioned onto the grid or to the services in a dynamic manner to support reliable and speedy business operations.

An EDF provides a distributed data layer required to maximize SOA and Grid deployments, significantly improving data virtualization, access and delivery to meet the demanding run-time metrics of these environments. Applications can scale transparently with an EDF and manage incremental additions of new users and new data sources, as well as increasing data volumes. An EDF offers guaranteed data access and reliability through its support for n-way replication and built-in persistence schemes for critical data elements. The flexible storage topologies of an EDF enable data to be stored and accessed in a fine- grained manner, improving application efficiency. Finally, an EDF can capture streaming “data in motion” and the temporal value of dynamic data, which is a requirement to support real-time decisions so common in analytic applications today.

Gt: How does an EDF utilize virtualization to manage data?

IYER: By acting as the uniform, universal data resource for distributed applications, the EDF virtualizes access to the underlying data sources through location transparency and multi-format support.

An EDF enables any enterprise node to transparently access data from any other node in a location-independent manner, without knowledge of actual data source or access protocol. Behind the scenes, data can be fetched from a peer node, from disk, or from a database.

An EDF can also deliver data to applications in the specific format they require, be it objects, XML, tables or events (data in motion). By encapsulating the necessary “operational data” for business processes, an EDF provides a layer of virtualized operational intelligence.

Gt: How does GemStone's EDF fit into the overall concept of a fabric?

IYER: GemStone's GemFire suite embodies all the characteristics of an enterprise data fabric. GemFire offers distributed data caching for storing objects, XML documents and relational tables while ensuring reliable data distribution and transport with messaging-like semantics. The event processing and SQL-based continuous querying functionality of GemFire enable intelligent data analysis. GemFire also provides open APIs for connectivity to backend data sources of any kind and allows data to be accessed via multiple APIs such as JCache, SQL, JDBC, C#/.NET, C++, XPath, SOAP and XML:DB.

Gt: Other vendors offer what they call “application fabrics.” How does a data fabric differ from an application fabric? How are they similar?

IYER: The term “fabric” applies to both in that the fabric is pervasive and virtualizes applications or data regardless of the underlying hardware resources on which they are provisioned. However, they have very different pieces of functionality and fit at very different levels in an IT infrastructure. A data fabric is very much part of an application architecture and is something that's much more than a convenience. It offers new, additional pieces of functionality not found in existing data infrastructure today, without which it's impossible to deploy highly responsive real-time business processes. My understanding of an application fabric is that it makes it easy to provision applications on a Grid- like infrastructure by providing fault tolerance and operational management features across multiple OSs and platforms.

Gt: What kind of demand have you seen for your EDF, and how has this manifested itself in terms of customer wins, etc?

IYER: GemStone's mission is to identify large-scale business problems and drive demand across a wide range of enterprises for this category of infrastructure software that we and the industry call a “data fabric.” We chose to pursue financial services enterprises and the federal sector, where the three-fold business drivers of “high speed operational efficiency,” “deep customer intimacy” and “real-time compliance and risk” manifested themselves the most.

Our next focus was to build breadth and significant depth in our technology and product offering. We are very proud of our foray and success thus far. We have a significant number of the top 20 financial services firms as our customers and expect these customers to be deploying us across the enterprise as a true fabric. In that sense, we have differentiated ourselves from other vendors that have approached this problem piecemeal vs. a complete solution. We believe that solving the hardest problems on Wall Street, in London and Washington, D.C., has helped us create a compelling product suite with a significant level of differentiation — both functionality-wise and attribute-wise. As a result, we are seeing tremendous traction in other industry segments, as well.

In addition, our corporate history of supporting mission-critical global installations 24×7 and our close working relationships with major partners such as IBM and Intel offers us an advantage that will help us drive significant adoption for this category of infrastructure software.

Gt: In what markets have you seen the greatest demand for EDF and similar technologies? Are there any specific markets you are looking to target in the future?

IYER: We believe that financial services, in particular capital markets will drive the greatest demand for the EDF in the short-term. The other sectors of the financial services industry such as asset management firms, retail institutions and insurance companies are starting to adopt the EDF in certain projects such as online services, real-time portfolio management and compliance.

Real-time operational intelligence is an area that we see gaining significant traction in our government business, and we expect this to start to play out in the commercial sectors, especially in sectors where there is inventory replenishment such as retail, consumer packaged goods and certain parts of manufacturing. We are also seeing strong demand in the online portals and media industry segment, as content delivery is a key challenge for companies in that market. Similarly, logistics and supply chains are other areas where increasingly decisions are being made at the “edge” of the enterprise. This decentralized decision making approach is driving the need for an intelligent data fabric to be present both at the edge and the core of the enterprise.

Gt: What do you see in the future for data fabrics and, more generally, data grids? How do you see demand for these solutions growing as Grid computing, SOA, etc., continue to evolve?

IYER: In the future, we see the data fabric emerging at the only data layer for all distributed applications, since by definition almost all applications are required to respond at the “right” time. This data layer will disintermediate existing sources of data such as databases. The data fabric is the manifestation of the notion that the “network is the database.” Clearly, SOA and Grid computing are two drivers that require the data fabric. We view “data grids” as one manifestation of the data fabric when you deploy grids. In addition, we see that technology initiatives such as operational business intelligence, real- time analytics and decision support, straight-through processing, and online portals will all require their own specific manifestations and implementations of the data fabric.

Gt: Is there anything else you'd like to add?

IYER: It's apparent from previous history that technology adoption happens in waves. We are in the midst of a change in technology adoption, where the hardware evolution toward utility computing and virtualization coupled with the move to Grid computing and SOA has necessitated that old paradigms be challenged. The emergence of an EDF as an infrastructure is a result of this requirement to deliver a truly operationally intelligent, active, distributed data infrastructure that supports these highly information-based initiatives. We, along with other vendors and analysts that have helped create this space, welcome this development, as it puts true innovation to work to solve practical problems.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Cray, Fujitsu Both Bringing Fujitsu A64FX-based Supercomputers to Market in 2020

November 12, 2019

The number of top-tier HPC systems makers has shrunk due to a steady march of M&A activity, but there is increased diversity and choice of processing components with Intel Xeon, AMD Epyc, IBM Power, and Arm server ch Read more…

By Tiffany Trader

SIA Recognizes Robert Dennard with 2019 Noyce Award

November 12, 2019

If you don’t know what Dennard Scaling is, the chances are strong you don’t labor in electronics. Robert Dennard, longtime IBM researcher, inventor of the DRAM and the fellow for whom Dennard Scaling was named, is th Read more…

By John Russell

Leveraging Exaflops Performance to Remediate Nuclear Waste

November 12, 2019

Nuclear waste storage sites are a subject of intense controversy and debate; nobody wants the radioactive remnants in their backyard. Now, a collaboration between Berkeley Lab, Pacific Northwest National University (PNNL Read more…

By Oliver Peckham

Using HPC and Machine Learning to Predict Traffic Congestion

November 12, 2019

Traffic congestion is a never-ending logic puzzle, dictated by commute patterns, but also by more stochastic accidents and similar disruptions. Traffic engineers struggle to model the traffic flow that occurs after accid Read more…

By Oliver Peckham

Mira Supercomputer Enables Cancer Research Breakthrough

November 11, 2019

Dynamic partial-wave spectroscopic (PWS) microscopy allows researchers to observe intracellular structures as small as 20 nanometers – smaller than those visible by optical microscopes – in three dimensions at a mill Read more…

By Staff report

AWS Solution Channel

Making High Performance Computing Affordable and Accessible for Small and Medium Businesses with HPC on AWS

High performance computing (HPC) brings a powerful set of tools to a broad range of industries, helping to drive innovation and boost revenue in finance, genomics, oil and gas extraction, and other fields. Read more…

IBM Accelerated Insights

IBM Adds Support for Ion Trap Quantum Technology to Qiskit

November 11, 2019

After years of percolating in the shadow of quantum computing research based on superconducting semiconductors – think IBM, Rigetti, Google, and D-Wave (quantum annealing) – ion trap technology is edging into the QC Read more…

By John Russell

Cray, Fujitsu Both Bringing Fujitsu A64FX-based Supercomputers to Market in 2020

November 12, 2019

The number of top-tier HPC systems makers has shrunk due to a steady march of M&A activity, but there is increased diversity and choice of processing compon Read more…

By Tiffany Trader

IBM Adds Support for Ion Trap Quantum Technology to Qiskit

November 11, 2019

After years of percolating in the shadow of quantum computing research based on superconducting semiconductors – think IBM, Rigetti, Google, and D-Wave (quant Read more…

By John Russell

Tackling HPC’s Memory and I/O Bottlenecks with On-Node, Non-Volatile RAM

November 8, 2019

On-node, non-volatile memory (NVRAM) is a game-changing technology that can remove many I/O and memory bottlenecks and provide a key enabler for exascale. Th Read more…

By Jan Rowell

MLPerf Releases First Inference Benchmark Results; Nvidia Touts its Showing

November 6, 2019

MLPerf.org, the young AI-benchmarking consortium, today issued the first round of results for its inference test suite. Among organizations with submissions wer Read more…

By John Russell

Azure Cloud First with AMD Epyc Rome Processors

November 6, 2019

At Ignite 2019 this week, Microsoft's Azure cloud team and AMD announced an expansion of their partnership that began in 2017 when Azure debuted Epyc-backed ins Read more…

By Tiffany Trader

Nvidia Launches Credit Card-Sized 21 TOPS Jetson System for Edge Devices

November 6, 2019

Nvidia has launched a new addition to its Jetson product line: a credit card-sized (70x45mm) form factor delivering up to 21 trillion operations/second (TOPS) o Read more…

By Doug Black

In Memoriam: Steve Tuecke, Globus Co-founder

November 4, 2019

HPCwire is deeply saddened to report that Steve Tuecke, longtime scientist at Argonne National Lab and University of Chicago, has passed away at age 52. Tuecke Read more…

By Tiffany Trader

Spending Spree: Hyperscalers Bought $57B of IT in 2018, $10B+ by Google – But Is Cloud on Horizon?

October 31, 2019

Hyperscalers are the masters of the IT universe, gravitational centers of increasing pull in the emerging age of data-driven compute and AI.  In the high-stake Read more…

By Doug Black

Supercomputer-Powered AI Tackles a Key Fusion Energy Challenge

August 7, 2019

Fusion energy is the Holy Grail of the energy world: low-radioactivity, low-waste, zero-carbon, high-output nuclear power that can run on hydrogen or lithium. T Read more…

By Oliver Peckham

Using AI to Solve One of the Most Prevailing Problems in CFD

October 17, 2019

How can artificial intelligence (AI) and high-performance computing (HPC) solve mesh generation, one of the most commonly referenced problems in computational engineering? A new study has set out to answer this question and create an industry-first AI-mesh application... Read more…

By James Sharpe

Cray Wins NNSA-Livermore ‘El Capitan’ Exascale Contract

August 13, 2019

Cray has won the bid to build the first exascale supercomputer for the National Nuclear Security Administration (NNSA) and Lawrence Livermore National Laborator Read more…

By Tiffany Trader

DARPA Looks to Propel Parallelism

September 4, 2019

As Moore’s law runs out of steam, new programming approaches are being pursued with the goal of greater hardware performance with less coding. The Defense Advanced Projects Research Agency is launching a new programming effort aimed at leveraging the benefits of massive distributed parallelism with less sweat. Read more…

By George Leopold

AMD Launches Epyc Rome, First 7nm CPU

August 8, 2019

From a gala event at the Palace of Fine Arts in San Francisco yesterday (Aug. 7), AMD launched its second-generation Epyc Rome x86 chips, based on its 7nm proce Read more…

By Tiffany Trader

D-Wave’s Path to 5000 Qubits; Google’s Quantum Supremacy Claim

September 24, 2019

On the heels of IBM’s quantum news last week come two more quantum items. D-Wave Systems today announced the name of its forthcoming 5000-qubit system, Advantage (yes the name choice isn’t serendipity), at its user conference being held this week in Newport, RI. Read more…

By John Russell

Ayar Labs to Demo Photonics Chiplet in FPGA Package at Hot Chips

August 19, 2019

Silicon startup Ayar Labs continues to gain momentum with its DARPA-backed optical chiplet technology that puts advanced electronics and optics on the same chip Read more…

By Tiffany Trader

Crystal Ball Gazing: IBM’s Vision for the Future of Computing

October 14, 2019

Dario Gil, IBM’s relatively new director of research, painted a intriguing portrait of the future of computing along with a rough idea of how IBM thinks we’ Read more…

By John Russell

Leading Solution Providers

ISC 2019 Virtual Booth Video Tour

CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
GOOGLE
GOOGLE
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
VERNE GLOBAL
VERNE GLOBAL

Intel Confirms Retreat on Omni-Path

August 1, 2019

Intel Corp.’s plans to make a big splash in the network fabric market for linking HPC and other workloads has apparently belly-flopped. The chipmaker confirmed to us the outlines of an earlier report by the website CRN that it has jettisoned plans for a second-generation version of its Omni-Path interconnect... Read more…

By Staff report

Kubernetes, Containers and HPC

September 19, 2019

Software containers and Kubernetes are important tools for building, deploying, running and managing modern enterprise applications at scale and delivering enterprise software faster and more reliably to the end user — while using resources more efficiently and reducing costs. Read more…

By Daniel Gruber, Burak Yenier and Wolfgang Gentzsch, UberCloud

Dell Ramps Up HPC Testing of AMD Rome Processors

October 21, 2019

Dell Technologies is wading deeper into the AMD-based systems market with a growing evaluation program for the latest Epyc (Rome) microprocessors from AMD. In a Read more…

By John Russell

Intel Debuts Pohoiki Beach, Its 8M Neuron Neuromorphic Development System

July 17, 2019

Neuromorphic computing has received less fanfare of late than quantum computing whose mystery has captured public attention and which seems to have generated mo Read more…

By John Russell

Rise of NIH’s Biowulf Mirrors the Rise of Computational Biology

July 29, 2019

The story of NIH’s supercomputer Biowulf is fascinating, important, and in many ways representative of the transformation of life sciences and biomedical res Read more…

By John Russell

Xilinx vs. Intel: FPGA Market Leaders Launch Server Accelerator Cards

August 6, 2019

The two FPGA market leaders, Intel and Xilinx, both announced new accelerator cards this week designed to handle specialized, compute-intensive workloads and un Read more…

By Doug Black

When Dense Matrix Representations Beat Sparse

September 9, 2019

In our world filled with unintended consequences, it turns out that saving memory space to help deal with GPU limitations, knowing it introduces performance pen Read more…

By James Reinders

With the Help of HPC, Astronomers Prepare to Deflect a Real Asteroid

September 26, 2019

For years, NASA has been running simulations of asteroid impacts to understand the risks (and likelihoods) of asteroids colliding with Earth. Now, NASA and the European Space Agency (ESA) are preparing for the next, crucial step in planetary defense against asteroid impacts: physically deflecting a real asteroid. Read more…

By Oliver Peckham

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This