The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
September 24, 2008
NEW YORK CITY -- Can hardware acceleration save Wall Street? Well, not as quickly as a multibillion-dollar bailout might, but there was plenty of discussion at this week's HPC on Wall Street conference about the advantages specialized hardware can bring to market analysts and traders. Sellers of these products were all over the place, their booths were busy, and several sessions on the subject were standing-room only.
The idea of separate appliances to speed up data processing has started catching on in financial services, said Geno Valente, VP of sales and marketing at XtremeData, Inc. "A few years ago, people were like, 'Who needs that?'" The expectation was that faster and faster CPUs would yield the processing and throughput speeds needed to respond to market changes. Plus, the FPGAs that are the brains of most accelerator boards were exotic to organizations outside the scientific community and required specialized parallel-programming skills to be used effectively.
But that's all changed, said Valente. Accelerators are now built into appliances from companies like Solace Systems and Exegy that "anyone can plug in and start using," he said. "Libraries are being developed that make acceleration technology available to people who don't know parallel-programming." As a result, "Public exchanges are using accelerators. Wall Street is now taking advantage of them. And there are a lot more companies using them that we can't talk about," he said.
Obviously performance -- faster processing of more data and more data streams -- is the primary advantage vendors mention when talking about their products. Their specialized processors handle the floating-point operations that crunch the algorithms that analysts and traders do-or-die upon. "Accelerator hardware enables us to do things we couldn't do otherwise," said Henry Young, founder of TS-Associates, an IT services company specializing in financial middleware. "We can handle a 10-gigabit data stream through a hardware accelerator to speed up processing. You can't compress a 10-gig stream like that with current CPU technology."
But it's not just speed. One reason Wall Street is getting on board is the need to score an edge over competitors and get a better handle on volatile markets. "Accelerators can differentiate a cluster," Valente said. "Otherwise you have exactly what the other guy has. It's accelerators and other customizable things you can add to a Linux box that give you an advantage."
Reliability and data precision were brought up as crucial benefits of acceleration hardware during a panel discussion. Simon McIntosh-Smith, VP of applications at ClearSpeed Technology, raised the spectre of "soft errors" resulting from cosmic emissions flipping bits. ClearSpeed makes an ASIC-based accelerator board that can plug into a server or be ganged up in a rack and connected to the network. What if an alpha emission hit a processor and altered the data from "sell 10,000 shares to buy 10,000"? In that case, you'd better hope you have hardware that supports error detection as well as error correction, McIntosh-Smith said. "The point is to make sure you have a system that supports high reliability. Some hardware accelerators support it, and some don't. Without reliability built in, you can have soft errors and not even realize it until it's too late."
While cosmic rays might be too sci-fi for other manufacturers, they still emphasize the high reliability features of their devices. Exegy uses reconfigurable hardware "so people can add logic to detect flipped bits or to add in more data protection as necessary," said Scott Parsons, the company's chief architect. And Solace Systems VP of architecture Shawn McAllister pointed out that Solace appliances can also have reliability features added. "We have firmware that monitors things and can take over in the event of a problem," he said.
Consolidation is another benefit, these hardware makers say. Exegy's technology is incorporated in a ticker based on reconfigurable hardware that "can handle all the North American market data feeds in one box rather than a dozen," Parsons said, with that stream including NYSE/SIAC, NASDAQ, OPRA, and ARCA. (See it in action at marketdatapeaks.com, he noted.)
"Datacenter consolidation is very important to our customers," McAllister said. "Some of them are in a situation where they just can't add another server until they take one out. Accelerators can help with that."
With appliances replacing big servers, in theory at least financial firms will save on utility bills. "We have seen lower power consumption at the system level with our FPGAs," Parsons noted.
Page: 1 of 2(Digg, Technorati, more)
Platform HPC Workgroup Manager
Platform HPC Workgroup Manager integrates all the cluster productivity tools you need to deploy, run and manage your HPC environment.
The ACM Turing Award goes to the creator of the modern personal computer; and Voltaire announces a mid-range InfiniBand switch and new technology that accelerates distributed applications. We recap those stories and more in our weekly wrapup.
Read More...
The prospects for virtual SMP technology got another boost last month when Florida State University announced it had installed a new HPC system from 3Leaf Systems. The servers are being housed at the university's HPC facility and will be used across a range of scientific disciplines.
Read More...
For the first time in 62 years, the four-man Olympics bobsled team from the US captured the gold medal, setting a course world record in the process. The winning bobsled had some state-of-the-art engineering behind it, including CFD software from Exa Corporation. As it turned out, that software may have proved to be the margin of difference in the race.
Read More...
Mar 11 | Linux Magazine | CUDA may be the rage, but OpenCL is a standard that has some features you may need. Read more...
Mar 09 | Free Software Magazine | Data-driven computing will need open software. Read more...
Mar 09 | Bio-IT World | Tahoe Informatics founder eyes GPUs, CUDA software. Read more...
Mar 08 | Sporting Life | Formula One engineers differ on benefits of CFD. Read more...
Mar 08 | InfoWorld | AMD offers up 48-core server prize. Read more...
Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.
Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.
Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.
Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.
LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html