‘High Latency Times, We Have You Surrounded.’

By By Derrick Harris, Editor

February 4, 2008

It’s nearly impossible to overstate the importance of low-latency solutions in financial datacenters — whether for risk analysis, electronic trade processing, or anything in between — which explains GemStone Systems’ recent partnerships aimed at addressing the issue on two different fronts.

Made public in November, the first of these partnerships is a go-to-market arrangement with Azul Systems aimed at addressing the multiple needs of users who need to improve latency, scalability and performance in the face of ever-increasing data volumes. By approaching potential customers together and touting the benefits of running GemStone’s GemFire Enterprise Data Fabric on top of the Azul Compute Appliance, both companies expect to see increased interest in their solutions. GemFire lets users create the types of highly available in-memory data grids necessary for extreme transaction processing (XTP) environments and Azul’s Compute Appliances supply the memory — ranging from 48 to 768 cores and from 96GB to 768GB of memory.

According to Asad Ali, senior product marketing manager at GemStone, testing between the two companies has shown that uploading an existing Java application into the GemStone-Azul environment is simply a matter of changing a few parameters, but the results belie the ease of deployment. Hundreds of commodity machines, he said, can be consolidated into several Azul appliances, and the combination of the proximity of the data and application, the reduction in networking, and the data being in-memory drastically speeds data access. Additionally, noted Ali, Azul’s no-pause garbage collection means Java applications can experience performance and scale the likes of which they rarely see in other environments.

Sanjay Sadhu, vice president of business development at Azul, is equally optimistic about the partnership, saying that a joint GemStone-Azul platform is actually greater than the sum of its parts. The financial services industry, he said, has serious latency concerns — on top of scalability, simplicity and availability concerns — yet many customers, including some top banks, “are not aware of a solution to the pain.” Combining Azul’s performance benefits with GemFire’s data access benefits not only solves these problems, but actually opens up new markets for institutions in terms of the number of traders who can access the data, said Sadhu. Azul Appliances can handle the needs of multiple applications because of the systems’ built-in SLA management, and GemFire allows multiple applications to access the data simultaneously.

Sadhu said the GemStone and Azul have been seeing a lot of interest in the joint solution, with most of it (perhaps not surprisingly) coming from the financial sector and focused on the data caching aspect — a critical element of the growing XTP market. However, both Sadhu and Ali agree that other vertical markets definitely could stand to benefit. Sadhu cites telco as one potential market, while Ali notes they are seeing growth in e-commerce and online gaming, as well. XTP is extremely important in transaction-intensive Web applications, a point Ali said was driven home by the number of retail Web sites that went down over Thanksgiving weekend.

Aside from handling the requirements of extreme transactional environments, Sadhu said a GemStone-Azul platform also helps give shape to grid and distributed environments by putting the focus on the application instead of on managing the environment. He can’t say whether the software or the hardware leads the solution, but together, he summarized, the companies solve problems — from giving power to Java applications to minimizing datacenter cost and complexity — that appeal to all levels of decision-makers. “We do see our value prop to be in the eyes and ears of CIOs and the architects who are building the solutions,” said Sadhu.

More recently, GemStone announced a partnership with IBM and Intel (and, to a lesser degree, Cisco) meant to address the extreme low-latency needs of the electronic trading industry. Called GemCache, the joint solution consists of GemStone’s GemFire software, IBM’s BladeCenter HS21 and Intel Quad-Core Xeon processors. In multi-server environments, the solution has utilized Cisco InfiniBand switches. According to Gideon Low, principal architect for business development and alliances at GemStone, GemCache is a result of common customers asking the three vendors to create a tight solution that addresses the customers’ real-world needs.

In order to demonstrate GemCache’s real-world throughput and latency capabilities, the companies put it through a first-of-its-kind benchmark test conducted by the Securities Technology Analysis Center (STAC). The solution demonstrated zero-loss reliability and guaranteed messaging into the transaction. As far as numbers go, the official announcement of the benchmark testing states:

The benchmark results showed the best-of-breed solution was able to support latency of less than 1 millisecond (987 msec) at 6,000 orders per second, with full data replication using a two-server GemCache configuration. In the tests, GemCache was also able to deliver a mean latency of 519 microseconds at 6,000 orders per second with a single server without replication. Additionally, three active/active two-server clusters supported 18,000 orders per second with approximately 1 millisecond (1,017 msec) of end-to-end latency using six IBM blade servers.

Near- or sub-millisecond latency times are needed to stay competitive in the trading markets, says Low, “but at the same time, you’re expected to be rock-solid, bulletproof, and never fail as a system and never lose data.” The numbers clearly illustrate that GemCache meets the former requirement, but it is the latter that often gets ignored. With GemCache, however, Low says data loss is all but eliminated via synchronous copying, and he said that they actually tightened the constraints in the benchmark test beyond what most customers do in their datacenters. Even pulling the plug on the primary processing machine did not result in data loss or impact on external applications, save for minimal failover time, he explained. Previous generations of solutions generally are several milliseconds slower, added Low, and cannot combine scalability, throughput and low latency like GemCache, nor can they generally handle both the database and messaging tiers like GemCache does.

Peter Lankford, founder and director of STAC, said the kinds of latencies demonstrated by GemCache are “significant” to end-users with whom his firm has spoken — users who usually are looking at roundtrip latency times in the low tens of milliseconds but want to go lower. Even more significant, said Lankford, is that GemStone, IBM and Intel did not bypass functionality in order to achieve an impressive number, but instead tried to construct a realistic benchmark with no data loss. Although this is the first execution-related benchmark STAC has published, Lankford added that it has created a standards organization over the past few months “to get everyone on the same page,” and the GemCache benchmark is a step in the right direction.

As for what drives what in a solution like this, Low is more definite than his more diplomatic GemStone colleague Sadhu. While Low acknowledges that hardware advances have been tremendous, he firmly believes the biggest difference maker in solutions like GemCache is the software architecture. Trying to carry out electronic trading transactions would be drastically slower using a traditional disk-based database architecture, he explained, so the move to an in-memory environment is critical — although having fast hardware certainly doesn’t hurt.

Like the GemStone-Azul solution, GemCache is available and in production today, although the pieces must be purchased individually. However, said Low, the companies involved are working on plans to co-market and co-sell the complete solution. As for the differences between the two environments, Low, who had a big part in the early testing work with GemFire and the Azul appliances, explained that the major differentiators are latency times and the amount of data that can be managed. While a GemStone-Azul environment cannot match the latency times of GemCache, the former, is very good for caching and managing a couple of hundred gigabytes of data while maintaining a better-than-average latency rate. As a result, said Low, GemCache is ideal for carrying out electronic trade processing, whereas the GemStone-Azul platform is better for real-time risk management or other processes that require the ability to drill into large amounts of data very quickly.

Regardless of what a customer’s needs are, though, “[low latency] gets more and more important every day,” said STAC’s Lankford, “and the reason is that in this market, invention is the mother of necessity. As soon as somebody down the street deploys some new technology that decreases their latency, everybody else has to keep up or they start losing deals.” Any delinquencies in latency are only exacerbated by the ever-increasing volumes of data and transactions firms are facing, as well as by the reality that machines are doing so much more trading than people, he added. “Once you make the decisions in silicon instead of neurons, now you’re on a completely different timescale.”

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

Penguin Computing Brings Cascade Lake-AP to OCP Form Factor

July 7, 2020

Penguin Computing, a subsidiary of SMART Global Holdings, Inc., is announcing a new Tundra server, Tundra AP, that is the first to implement the Intel Xeon Scalable 9200 series processors (codenamed Cascade Lake-AP) in t Read more…

By Tiffany Trader

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia's Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 "Accelerator Optimized" VM A2 instance family on Google Compute Engine. The instances are powered by t Read more…

By Tiffany Trader

Q&A: HLRS’s Bastian Koller Tackles HPC and Industry in Germany and Europe

July 6, 2020

HPCwire: Let's start with HLRS and work our way up to the European scale. HLRS has stood out in the HPC world for its support of both scientific and industrial research. Can you discuss key developments in recent years? Read more…

By Steve Conway, Hyperion

The Barcelona Supercomputing Center Offers a Virtual Tour of Its MareNostrum Supercomputer

July 6, 2020

With the COVID-19 pandemic continuing to threaten the world and disrupt normal operations, facility tours remain a little difficult to operate, with many supercomputing centers having shuttered facility tours for visitor Read more…

By Oliver Peckham

What’s New in Computing vs. COVID-19: Fugaku, Congress, De Novo Design & More

July 2, 2020

Supercomputing, big data and artificial intelligence are crucial tools in the fight against the coronavirus pandemic. Around the world, researchers, corporations and governments are urgently devoting their computing reso Read more…

By Oliver Peckham

AWS Solution Channel

Maxar Builds HPC on AWS to Deliver Forecasts 58% Faster Than Weather Supercomputer

When weather threatens drilling rigs, refineries, and other energy facilities, oil and gas companies want to move fast to protect personnel and equipment. And for firms that trade commodity shares in oil, precious metals, crops, and livestock, the weather can significantly impact their buy-sell decisions. Read more…

Intel® HPC + AI Pavilion

Supercomputing the Pandemic: Scientific Community Tackles COVID-19 from Multiple Perspectives

Since their inception, supercomputers have taken on the biggest, most complex, and most data-intensive computing challenges—from confirming Einstein’s theories about gravitational waves to predicting the impacts of climate change. Read more…

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time last year, IBM announced open sourcing its Power instructio Read more…

By John Russell

Google Cloud Debuts 16-GPU Ampere A100 Instances

July 7, 2020

On the heels of the Nvidia's Ampere A100 GPU launch in May, Google Cloud is announcing alpha availability of the A100 "Accelerator Optimized" VM A2 instance fam Read more…

By Tiffany Trader

Q&A: HLRS’s Bastian Koller Tackles HPC and Industry in Germany and Europe

July 6, 2020

HPCwire: Let's start with HLRS and work our way up to the European scale. HLRS has stood out in the HPC world for its support of both scientific and industrial Read more…

By Steve Conway, Hyperion

OpenPOWER Reboot – New Director, New Silicon Partners, Leveraging Linux Foundation Connections

July 2, 2020

Earlier this week the OpenPOWER Foundation announced the contribution of IBM’s A21 Power processor core design to the open source community. Roughly this time Read more…

By John Russell

Hyperion Forecast – Headwinds in 2020 Won’t Stifle Cloud HPC Adoption or Arm’s Rise

June 30, 2020

The semiannual taking of HPC’s pulse by Hyperion Research – late fall at SC and early summer at ISC – is a much-watched indicator of things come. This yea Read more…

By John Russell

Racism and HPC: a Special Podcast

June 29, 2020

Promoting greater diversity in HPC is a much-discussed goal and ostensibly a long-sought goal in HPC. Yet it seems clear HPC is far from achieving this goal. Re Read more…

Top500 Trends: Movement on Top, but Record Low Turnover

June 25, 2020

The 55th installment of the Top500 list saw strong activity in the leadership segment with four new systems in the top ten and a crowning achievement from the f Read more…

By Tiffany Trader

ISC 2020 Keynote: Hope for the Future, Praise for Fugaku and HPC’s Pandemic Response

June 24, 2020

In stark contrast to past years Thomas Sterling’s ISC20 keynote today struck a more somber note with the COVID-19 pandemic as the central character in Sterling’s annual review of worldwide trends in HPC. Better known for his engaging manner and occasional willingness to poke prickly egos, Sterling instead strode through the numbing statistics associated... Read more…

By John Russell

ISC 2020’s Student Cluster Competition Winners Announced

June 24, 2020

Normally, the Student Cluster Competition involves teams of students building real computing clusters on the show floors of major supercomputer conferences and Read more…

By Oliver Peckham

Supercomputer Modeling Tests How COVID-19 Spreads in Grocery Stores

April 8, 2020

In the COVID-19 era, many people are treating simple activities like getting gas or groceries with caution as they try to heed social distancing mandates and protect their own health. Still, significant uncertainty surrounds the relative risk of different activities, and conflicting information is prevalent. A team of Finnish researchers set out to address some of these uncertainties by... Read more…

By Oliver Peckham

[email protected] Turns Its Massive Crowdsourced Computer Network Against COVID-19

March 16, 2020

For gamers, fighting against a global crisis is usually pure fantasy – but now, it’s looking more like a reality. As supercomputers around the world spin up Read more…

By Oliver Peckham

[email protected] Rallies a Legion of Computers Against the Coronavirus

March 24, 2020

Last week, we highlighted [email protected], a massive, crowdsourced computer network that has turned its resources against the coronavirus pandemic sweeping the globe – but [email protected] isn’t the only game in town. The internet is buzzing with crowdsourced computing... Read more…

By Oliver Peckham

Global Supercomputing Is Mobilizing Against COVID-19

March 12, 2020

Tech has been taking some heavy losses from the coronavirus pandemic. Global supply chains have been disrupted, virtually every major tech conference taking place over the next few months has been canceled... Read more…

By Oliver Peckham

Supercomputer Simulations Reveal the Fate of the Neanderthals

May 25, 2020

For hundreds of thousands of years, neanderthals roamed the planet, eventually (almost 50,000 years ago) giving way to homo sapiens, which quickly became the do Read more…

By Oliver Peckham

DoE Expands on Role of COVID-19 Supercomputing Consortium

March 25, 2020

After announcing the launch of the COVID-19 High Performance Computing Consortium on Sunday, the Department of Energy yesterday provided more details on its sco Read more…

By John Russell

Steve Scott Lays Out HPE-Cray Blended Product Roadmap

March 11, 2020

Last week, the day before the El Capitan processor disclosures were made at HPE's new headquarters in San Jose, Steve Scott (CTO for HPC & AI at HPE, and former Cray CTO) was on-hand at the Rice Oil & Gas HPC conference in Houston. He was there to discuss the HPE-Cray transition and blended roadmap, as well as his favorite topic, Cray's eighth-gen networking technology, Slingshot. Read more…

By Tiffany Trader

Honeywell’s Big Bet on Trapped Ion Quantum Computing

April 7, 2020

Honeywell doesn’t spring to mind when thinking of quantum computing pioneers, but a decade ago the high-tech conglomerate better known for its control systems waded deliberately into the then calmer quantum computing (QC) waters. Fast forward to March when Honeywell announced plans to introduce an ion trap-based quantum computer whose ‘performance’ would... Read more…

By John Russell

Leading Solution Providers

Contributors

Neocortex Will Be First-of-Its-Kind 800,000-Core AI Supercomputer

June 9, 2020

Pittsburgh Supercomputing Center (PSC - a joint research organization of Carnegie Mellon University and the University of Pittsburgh) has won a $5 million award Read more…

By Tiffany Trader

‘Billion Molecules Against COVID-19’ Challenge to Launch with Massive Supercomputing Support

April 22, 2020

Around the world, supercomputing centers have spun up and opened their doors for COVID-19 research in what may be the most unified supercomputing effort in hist Read more…

By Oliver Peckham

Nvidia’s Ampere A100 GPU: Up to 2.5X the HPC, 20X the AI

May 14, 2020

Nvidia's first Ampere-based graphics card, the A100 GPU, packs a whopping 54 billion transistors on 826mm2 of silicon, making it the world's largest seven-nanom Read more…

By Tiffany Trader

Australian Researchers Break All-Time Internet Speed Record

May 26, 2020

If you’ve been stuck at home for the last few months, you’ve probably become more attuned to the quality (or lack thereof) of your internet connection. Even Read more…

By Oliver Peckham

10nm, 7nm, 5nm…. Should the Chip Nanometer Metric Be Replaced?

June 1, 2020

The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* – with 5nm and 3nm on the way – has been i Read more…

By Doug Black

15 Slides on Programming Aurora and Exascale Systems

May 7, 2020

Sometime in 2021, Aurora, the first planned U.S. exascale system, is scheduled to be fired up at Argonne National Laboratory. Cray (now HPE) and Intel are the k Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

TACC Supercomputers Run Simulations Illuminating COVID-19, DNA Replication

March 19, 2020

As supercomputers around the world spin up to combat the coronavirus, the Texas Advanced Computing Center (TACC) is announcing results that may help to illumina Read more…

By Staff report

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This