The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
September 23, 2008
NEW YORK CITY -- When profits drop, businesses look to boost productivity and performance -- and nowhere is that demand more urgent right now than on Wall Street. Yesterday, about 60 blocks north of the scene of the recent financial meltdown, Microsoft announced it has released its latest product to provide that boost: Windows HPC Server 2008. The company says the new version will give firms in the financial services business a way to easily and cost-effectively deploy scalable high performance systems.
"Companies have to be more efficient than ever with IT resources, but they need to maintain their position in a competitive marketplace," said Bill Laing, VP of Microsoft's Windows Server and Solutions Division, during a speech at the HPC on Wall Street conference yesterday. Financial organizations are relying more and more on high performance systems for routine but critical operations such as real-time risk analysis, Laing said, but "they require HPC solutions that deploy quickly, integrate in a heterogeneous environment, and scale from workstation to cluster."
Built on 64-bit Windows Server, the new platform essentially puts the Windows interface on top of high-speed compute clusters. "We're providing supercomputing to the desktop guys, the financial analysts and the ones developing models -- the guys doing real-time market calculations," said Vince Mendillo, director of Microsoft's Server & Tools Business Group, during a briefing. "Our goal is to accelerate the time to insight."
Microsoft worked with dozens of companies in the financial industry to get their feedback to the server system, Laing said. One such company is Lloyds TSB, one of the largest banking groups in the UK. The IT director at Lloyds TSB Corporate Markets group in London, Ricky Higgins, reported that his team was able to stand up a new 64-node cluster in a very short time. "From bare hardware to first job submitted took barely overnight," he said. "Due to market turmoil, we need to process data much more quickly than ever before." Higgins said processing time has been cut by about 50 percent. "We've been able to greatly increase the number of transactions," he said.
To speed up processing of financial workloads, Microsoft made a series of major changes to HPC Server. Instead of using Remote Installation Service to set up a cluster, HPC Server uses Windows Deployment Service, which the company says makes scaling much faster because it uses image multicasting to deploy nodes in parallel, but it's also easier because a wizard system guides administrators through node configuration. A "to-do list" page walks the admin through the steps needed to configure a cluster, such as defining the network topology and setting up automatic deployment.
In fact, Microsoft lists simplified administration as one of the key benefits of the new platform. "Our goal was to provide efficient, scalable management tools for setting up and deploying a cluster. Reporting capabilities are very easy to use," Mendillo said. Along with reporting, monitoring and diagnostic tools are all built into the new management console. A good example is the Heat Map, which gives an at-a-glance look at the health of the cluster.
Remote Direct Memory Access enables process-to-process communications, so "there's very low latency when sending a process from one machine to another," said Mendillo. Processes can write directly to the address space in another machine. The new job scheduler has been upgraded to work better with large clusters, handle more simultaneous chores, and be used in service-oriented applications, he said. The software now follows the Open Grid Forum's HPC Basic Profile interface for interoperability with other schedulers.
Reliability is strengthened with advanced failover capabilities. "Redundancy on head nodes guarantees that the cluster will keep running, and job scheduler clients won't see any change in the head node during the failover process," explained Mendillo.
Microsoft has been working with independent software developers to build scalable applications for risk analysis, modeling trading, and other financial operations, as well as compilers, debuggers, performance optimizers, libraries, and other essential tools. Through integration with Visual Studio 2008, with its parallel programming environment, the new platform makes it easier to build software that takes advantage of distributed processing power, explained Medillo.
It's not as if HPC is new in the financial district. Like Geno Valente, a VP for database analytics device developer XtremeData, said during a session yesterday, "Most people on Wall Street have some kind of HPC in the back room."
Page: 1 of 2(Digg, Technorati, more)
New Paper: Parallel Computing Without Parallel Programming
Learn how domain experts can run VHLL programs like MATLAB® on a variety of high-performance platforms without low-level reprogramming and how to work with the largest datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Spider, the world's biggest Lustre-based, centerwide file system, has been fully tested to support Oak Ridge National Laboratory's new petascale Cray XT4/XT5 Jaguar supercomputer and is now offering early access to scientists.
Read More...
Wolfram Alpha, the Web-based computational engine introduced in May, is not a traditional supercomputing application, but relies on supercomputers to satisfy its unique requirements.
Read More...
There was a new energy at this year's TeraGrid '09 conference thanks to an outstanding turnout for the student program. Thanks to support from the National Science Foundation, more than 100 high school, undergraduate and graduate students were able to participate in the conference.
Read More...
Jul 09 | Engineer Live | The demand for computational tools to underpin the 3D seismic interpretation process has never been more apparent. Read more...
Jul 08 | EE Times | Unemployment for U.S. engineers has reached record levels, according to government figures. Read more...
Jul 08 | Network World | Global spending for 2009 projected to drop 6 percent, for a total of $3.2 trillion. Read more...
Jul 08 | Linux Magazine | Portability or efficiency? Neither is guaranteed when writing explicit parallel code. Read more...
Jul 07 | Ars Technica | Japanese company builds custom ASIC to accelerate real-time ray traced rendering for the auto industry. Read more...
Jul 10 | | Engineers, scientists, and other domain experts depend on the productivity enabled by very high-level language (VHLL) tools like MATLAB® and Python. However, as datasets grow larger and programs get more sophisticated, ordinary desktop computers can no longer keep up. The paper explores how to run VHLL programs on high-performance platforms without low-level reprogramming. Work with large datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.