XTP Platforms: Ready to Make their Mark

By By Derrick Harris, Editor

February 18, 2008

Only one year ago, Gartner analyst Massimo Pezzini described grid-based application platforms as a burgeoning technology that might just be ready to tackle the demands of extreme transaction processing (XTP) environments. My, how times have changed. In an October 2007 report titled “The Birth of the Extreme Transaction Processing Platform: Enabling a Service-Oriented Architecture, Events and More,” Pezzini wrote that many XTP-enabling technologies — including grid-based application platforms — are “technically credible” alternatives to traditional application servers and, although still in use by only the leading edge of companies, have enough of an installation base “to prove they can address real requirements.” Put simply: grid-based application platforms are for real, and true extreme transaction-processing platforms (XTPP) are on the horizon.

According to the report — and easily evidenced by speaking with end-users — traditional online transaction-processing (OLTP) architectures are wearing thin because of a bombardment of transactions caused in part by today’s service-oriented and event-driven architectures. In addition, the completion times of transactions — especially in markets like electronic trading — are expected to be significantly lower, even while associated data volumes are growing — often times exponentially.

The ultimate platform to address these concerns will be the XTPP, which according to Pezzini will include the following features: a cohesive programming model; event-processing and service containers; a flow management container; a batch container; a common distributed transaction manager; a high-performance computing fabric; tera-architecture support; and development tool, security, administration and management capabilities. The development of robust XTPPs, wrote Pezzini, is evidenced by expanded capabilities of traditional solutions by vendors like Oracle, BEA Systems and Tibco, as well as by the increasing XTP holism of leading-edge application platforms offered by companies like IBM, GigaSpaces and Appistry.

“One Platform to Rule them All”

One of the first to latch onto Pezzini’s research and market itself as a grid-based application platform, as well as a player in the XTP space, Appistry is particularly pleased with the sunny forecast it is seeing for solutions like its Enterprise Application Fabric (EAF). Of particular interest to Sam Charrington, Appistry’s vice president of product management and marketing, is the Gartner report’s prediction that: “By 2012, mounting user need for XTP applications and technology innovation will propel at least one new software vendor into leadership in the application platform market with more than 15% market share in the XTP platform segment.”

Injecting a little Middle Earth into the XTP discussion, Charrington commented that Gartner’s prediction for XTPPs seems to be that there will be “one platform to rule them all.” Having been called all of those things — from application server to SOA to grid-based application platform — he believes Appistry is in a good position to be among the market leaders. While vendors selling new technologies always want to talk about how it works with existing technologies, Charrington said more and more customers are interested in EAF in place of their current application servers. “I think the reason why there are so many names out there for technologies like ours is because … there is something new that is being born,” he said.

EAF has always been about the application, and in order to ease the process of running applications on it — as well as to allay potential concerns about the steep learning curve that comes with replacing an existing application environment — Appistry has been working hard to make EAF compatible with existing applications and codes. In the past, explained Charrington, applications had to written to EAF’s specific API and had to be aware that they were running in a fabric environment. Now, however, developers can write applications using the Spring Framework, .NET or plain-old Java and deploy them in the fabric without making any changes.

One of Gartner’s concerns about the XTPP market is that it doesn’t have formal standards just yet, but Charrington sees the application platform world creating its own de facto standards by making their products compatible with Spring, POJO, .NET, etc. There is more going on than Gartner might lead you to believe, says Charrington, and while Appistry and others do have a vested interest in providing standards where necessary, this focus on everyday development models means, in the very least, that customers don’t have to be locked into specific platforms.

Overall, said Charrington, the whole ride has been exciting for Appistry, as what required a lot of education a couple of years ago, people seem to get now. “The problems are becoming apparent to customers as they try to keep up with their competition [and] the requirements of their customers,” he observed. “Our customers are wanting real-time access to information, ‘anytime, any place.'” This makes for fertile ground, added Charrington, as less time spent educating customers means more time spent focusing on improving the solution.

Tackling XTP with EAF

In late 2006, when we first covered XTP, we spoke with Appistry customer Clearent, who was getting set to take its credit card payment-processing service live on EAF. Clearent has been up and running for a year now, and Vice President of Product Development Mark Peck says EAF has allowed the company keep processing transactions day and night with no interruptions.

In Clearent’s line of business, he explained, the business day lasts from sunup on the East Coast until sundown on the West Coast, and his company has to provide clients with up-to-date Web information on all the transactions that have been processed. And the setting sun doesn’t mean Clearent’s infrastructure can take a break. “When the sun does go down … and the last bars and restaurants close down and our merchants are processing transactions, and batching them up for processing, we’re getting overnight feeds that have to be accommodated,” Peck explained. “The fact that we can perform system upgrades in real time without having to bring the system down is … a big win for us in this industry.”

Clearly, high availability and low latency are essential to any business handling as many transactions as Clearent (which has its sights set on upward of 500 per second), so the company has made Appistry’s fabric a big part of both its customer-Web-request and transaction-processing environments. “The ability to service those Web requests in a timely fashion is key to the end-user’s perception of our service,” said Peck. Latency concerns, of course, come into play on the transactional side, where they are critical. Clearent has a narrow window to get the transactions from the card association, process them, apply the appropriate billing and pricing, and then convey them for clearing and settlement. “Within that window,” said Peck, “even if it’s running in a batch mode, we can’t afford to spend very much time on any one given transaction.”

Even given the success Clearent has seen with EAF as it moves toward becoming a true XTP shop, Peck still believes his company is in the minority when it comes to leveraging this type of solution, and thus has a “tremendous advantage” over competitors — but that is bound to change. “I think it’s going to be impossible for somebody to come into this space and compete effectively at the scales and demands — in terms of the real-time transaction processing, the robustness, the ease of use … without having a platform like Appistry’s or some of these extreme transaction platforms,” predicted Peck. “It’s going to be, if not impossible, certainly extremely difficult.”

Big Blue’s XTP Play

For its part, IBM is selling WebSphere Extended Deployment (XD), a software solution designed to virtualize and optimize existing application infrastructures. Although it provides the richest experience with WebSphere, XD supports a slew of application servers, including BEA WebLogic, SAP NetWeaver, JBoss and Apache Tomcat. XD consists of three components — operations optimization, data grid and compute grid — that are available as an integrated package or as individual pieces. Operations optimization provides capabilities like application virtualization, dynamic resource allocation and policy-based management. The compute grid component allows developers to write high-performance, parallelizable Java applications. In many ways, however, IBM considers XD’s real differentiator to be its data grid component, which is powered by IBM’s ObjectGrid technology.

Matt Haynos, project manager for WebSphere XD, says data growth is crippling application performance in traditional infrastructures, which has led customers to products like ObjectGrid, Oracle Coherence or GigaSpaces eXtreme Application Platform, among others. These products allow users to design their data infrastructures first, and then move the business logic or code to the data. “The real cool thing about ObjectGrid,” said Haynos, “is that you can maintain consistent application response even if your data doubles.” And XD handles the scalability challenges brought on by data growth, as well. Just plug in additional servers as data volumes grow, says Haynos, and XD scales linearly, automatically rebalancing the data.

Billy Newport, a distinguished engineer at IBM, believes there are two markets for data grid and distributed caching technologies like ObjectGrid: (1) trading/investment banking, where users understand in detail their architectural needs and develop very specialized infrastructures and applications to deliver near-millisecond response times; and (2) everyone else. There are many normal customers that are just running into walls in terms of data growth, datacenter power woes, etc., who want a solution that will fit in with what they’re already doing as unobtrusively as possible, said Newport. He added that the latter group is probably the bigger market opportunity.

Among the non-financial applications best suited to XTPPs, said Newport, are those involving complex-event processing (CEP) and those needing to deliver low latency times while mining large in-memory datasets. An example of the latter would be predictive analysis medical applications that sift through gigabytes of data in order to discover trends, similarities, etc. “The argument for [data caching] is you think you will be touching the data often enough that the cost of routing the logic over there is cheaper than touching the data remotely,” he explained.

Expanding a little on Gartner’s definition of what an XTPP includes, Newport says the first thing an XTPP needs is a replicated memory storage system, so that when a virtual machine comes up, it can automatically start storing data to the grid, and the grid knows to replicate that data somewhere for the sake of fault tolerance. As opposed to writing to disk, “With this memory-based approach,” explained Newport, “the only things you’re really limited on are CPU, network and memory — and all of those three variables scale linearly as you add boxes.” With ObjectGrid’s state-of-the-art memory-based infrastructure, he added, the only problem with scale is finding enough boxes.

In terms of how ObjectGrid, and WebSphere XD as a whole, compare with competitive solutions, Newport said that ObjectGrid and Oracle Coherence are both embeddable data grids. He believes IBM’s product definitely works better in WebSphere environments and also works better on enterprise networks thanks to its ability to asynchronously replicate data across datacenters and topologies. When compared to GigaSpaces, Newport sees the big difference to be GigaSpaces’ goal of replacing the current application platform, as well as its tight alignment with the Spring framework. XD, he explained, is working with Spring and is capable of serving as the application platform, but its general purpose is to optimize customers’ current setups.

Interestingly, however, IBM and Appistry actually have been working to exploit the complementary natures of ObjectGrid and Appistry’s EAF. Appistry has its Fabric-Accessible Memory feature, acknowledged Newport, but it’s not a coherent, robust data grid. “There are two ways of looking at XTP,” he said, “but … Appistry … doesn’t address scaling of the backend; it addresses scaling of the application.”

Appistry’s Charrington takes a similar view, noting that Appistry and IBM have been partners for years and that, “Particularly around XTP, I think IBM and Appistry both believe that grid-based application platforms, like what we’ve got with EAF, and distributed caches, like what they have with ObjectGrid, are both important pieces of the overall XTP puzzle from a customer perspective.” The companies have integrated the solutions in the field, he added, and are continuing to assess their options around integrating the two solutions out of the box.

Aside from working with Appistry, IBM is continuing its quest to improve ObjectGrid and to find ways to optimize other technologies using data grid technologies. The company just increased its investment in ObjectGrid by 50 percent, noted Newport, and it is looking for ways to build a CEP platform on top of ObjectGrid, a task made easier with IBM’s recent acquisition of AptSoft and its CEP engine. Support for alternate languages, such as C++ and .NET, also should be on the way, he said.

By refusing to rest on its laurels and advancing these types of efforts, IBM hopes to make the technology easier to consume and tap into the vast market of users who aren’t as advanced as their financial counterparts. “The perception right now is that caching is an expensive technology to deploy because of development costs … and things like that,” said Newport. “The more ‘de-skilled,’ if you want, we can make deploying cache technology, the better off we’ll be and the better off the customers are going to be.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

SODALITE: Towards Automated Optimization of HPC Application Deployment

May 29, 2020

Developing and deploying applications across heterogeneous infrastructures like HPC or Cloud with diverse hardware is a complex problem. Enabling developers to describe the application deployment and optimising runtime p Read more…

By the SODALITE Team

What’s New in HPC Research: Astronomy, Weather, Security & More

May 29, 2020

In this bimonthly feature, HPCwire highlights newly published research in the high-performance computing community and related domains. From parallel programming to exascale to quantum computing, the details are here. Read more…

By Oliver Peckham

DARPA Looks to Automate Secure Silicon Designs

May 28, 2020

The U.S. military is ramping up efforts to secure semiconductors and its electronics supply chain by embedding defenses during the chip design phase. The automation effort also addresses the high cost and complexity of s Read more…

By George Leopold

COVID-19 HPC Consortium Expands to Europe, Reports on Research Projects

May 28, 2020

The COVID-19 HPC Consortium, a public-private effort delivering free access to HPC processing for scientists pursuing coronavirus research – some utilizing AI-based techniques – has expanded to more than 56 research Read more…

By Doug Black

What’s New in Computing vs. COVID-19: IceCube, TACC, Watson & More

May 28, 2020

Supercomputing, big data and artificial intelligence are crucial tools in the fight against the coronavirus pandemic. Around the world, researchers, corporations and governments are urgently devoting their computing reso Read more…

By Oliver Peckham

AWS Solution Channel

Computational Fluid Dynamics on AWS

Over the past 30 years Computational Fluid Dynamics (CFD) has grown to become a key part of many engineering design processes. From aircraft design to modelling the blood flow in our bodies, the ability to understand the behaviour of fluids has enabled countless innovations and improved the time to market for many products. Read more…

Supercomputer Simulations Explain the Asteroid that Killed the Dinosaurs

May 28, 2020

The supercomputing community has cataclysms on the mind. Hot on the heels of supercomputer-powered research delving into the fate of the neanderthals, a team of researchers used supercomputers at the DiRAC (Distributed R Read more…

By Oliver Peckham

COVID-19 HPC Consortium Expands to Europe, Reports on Research Projects

May 28, 2020

The COVID-19 HPC Consortium, a public-private effort delivering free access to HPC processing for scientists pursuing coronavirus research – some utilizing AI Read more…

By Doug Black

$100B Plan Submitted for Massive Remake and Expansion of NSF

May 27, 2020

Legislation to reshape, expand - and rename - the National Science Foundation has been submitted in both the U.S. House and Senate. The proposal, which seems to Read more…

By John Russell

IBM Boosts Deep Learning Accuracy on Memristive Chips

May 27, 2020

IBM researchers have taken another step towards making in-memory computing based on phase change (PCM) memory devices a reality. Papers in Nature and Frontiers Read more…

By John Russell

Hats Over Hearts: Remembering Rich Brueckner

May 26, 2020

HPCwire and all of the Tabor Communications family are saddened by last week’s passing of Rich Brueckner. He was the ever-optimistic man in the Red Hat presiding over the InsideHPC media portfolio for the past decade and a constant presence at HPC’s most important events. Read more…

Nvidia Q1 Earnings Top Expectations, Datacenter Revenue Breaks $1B

May 22, 2020

Nvidia’s seemingly endless roll continued in the first quarter with the company announcing blockbuster earnings that exceeded Wall Street expectations. Nvidia Read more…

By Doug Black

Microsoft’s Massive AI Supercomputer on Azure: 285k CPU Cores, 10k GPUs

May 20, 2020

Microsoft has unveiled a supercomputing monster – among the world’s five most powerful, according to the company – aimed at what is known in scientific an Read more…

By Doug Black

HPC in Life Sciences 2020 Part 1: Rise of AMD, Data Management’s Wild West, More 

May 20, 2020

Given the disruption caused by the COVID-19 pandemic and the massive enlistment of major HPC resources to fight the pandemic, it is especially appropriate to re Read more…

By John Russell

AMD Epyc Rome Picked for New Nvidia DGX, but HGX Preserves Intel Option

May 19, 2020

AMD continues to make inroads into the datacenter with its second-generation Epyc "Rome" processor, which last week scored a win with Nvidia's announcement that Read more…

By Tiffany Trader

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers

SC 2019 Virtual Booth Video Tour

AMD
AMD
ASROCK RACK
ASROCK RACK
AWS
AWS
CEJN
CJEN
CRAY
CRAY
DDN
DDN
DELL EMC
DELL EMC
IBM
IBM
MELLANOX
MELLANOX
ONE STOP SYSTEMS
ONE STOP SYSTEMS
PANASAS
PANASAS
SIX NINES IT
SIX NINES IT
VERNE GLOBAL
VERNE GLOBAL
WEKAIO
WEKAIO

Contributors

Fujitsu A64FX Supercomputer to Be Deployed at Nagoya University This Summer

February 3, 2020

Japanese tech giant Fujitsu announced today that it will supply Nagoya University Information Technology Center with the first commercial supercomputer powered Read more…

By Tiffany Trader

Tech Conferences Are Being Canceled Due to Coronavirus

March 3, 2020

Several conferences scheduled to take place in the coming weeks, including Nvidia’s GPU Technology Conference (GTC) and the Strata Data + AI conference, have Read more…

By Alex Woodie

Exascale Watch: El Capitan Will Use AMD CPUs & GPUs to Reach 2 Exaflops

March 4, 2020

HPE and its collaborators reported today that El Capitan, the forthcoming exascale supercomputer to be sited at Lawrence Livermore National Laboratory and serve Read more…

By John Russell

Cray to Provide NOAA with Two AMD-Powered Supercomputers

February 24, 2020

The United States’ National Oceanic and Atmospheric Administration (NOAA) last week announced plans for a major refresh of its operational weather forecasting supercomputers, part of a 10-year, $505.2 million program, which will secure two HPE-Cray systems for NOAA’s National Weather Service to be fielded later this year and put into production in early 2022. Read more…

By Tiffany Trader

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This