HPCwire

The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing

HPCwire >> Blogs

Blog: From the Editor

From the Editor | Main Blog Index

Quants Gone Wild


It's fascinating to read the post-mortem analysis of the economic meltdown, especially as it relates to the role quantitative analysts and their high-tech financial models played in pushing the industry off a cliff.

In a Wired article this week titled The Formula That Killed Wall Street, Felix Salmon writes about how a single formula, the Gaussian copula function, came to dominate financial risk modeling, and how it ultimately undermined the investment industry. The formula was the brainchild of David Li, a quantitative analyst (quant) who developed Gaussian copula to correlate risk in the now infamous collateralized debt obligations (CDOs) and credit default swaps (CDSs).

To distill the global financial collapse down to a single mathematical formula seems like a stretch, but Salmon makes a compelling case for how the Gaussian copula function insinuated itself into the ecosystem of professional financial analysts and investors:

For five years, Li's formula, known as a Gaussian copula function, looked like an unambiguously positive breakthrough, a piece of financial technology that allowed hugely complex risks to be modeled with more ease and accuracy than ever before. With his brilliant spark of mathematical legerdemain, Li made it possible for traders to sell vast quantities of new securities, expanding financial markets to unimaginable levels.

His method was adopted by everybody from bond investors and Wall Street banks to ratings agencies and regulators. And it became so deeply entrenched--and was making people so much money--that warnings about its limitations were largely ignored.

Then the model fell apart...

As it turns out, Gaussian copula, while elegant, was much too simplistic. For example, since the formula ignored the interrelationships of the individual loans that made up a CDO, as well as the historical data of housing assets, the risk correlation was all based on short-term behavior -- in this case, at a time when housing prices were rising dramatically. Investment bankers should have known that the risk was still out there. So, asks Salmon, why didn't the bankers question where the risk had gone?

They didn't know, or didn't ask. One reason was that the outputs came from "black box" computer models and were hard to subject to a commonsense smell test. Another was that the quants, who should have been more aware of the copula's weaknesses, weren't the ones making the big asset-allocation decisions. Their managers, who made the actual calls, lacked the math skills to understand what the models were doing or how they worked.

Quantitative finance guru Paul Wilmott, who was cited in the Wired piece as one of the original critics of the copula model -- he's more of a Black-Scholes kind of guy -- thinks the industry's unexamined reliance on copula is just a symptom of a wider problem in the financial industry. In his blog this week, he laments about the cult-like tendencies that permeate the financial community:

Far more serious, because it extends to all of finance not just to a single model, is the poor education that people get in university financial engineering programs and also the blind-following-the-blind behavior that is so common throughout the industry.... It's getting quite tedious me telling people to get off their backsides and test the models for themselves.

The failure of the models is certain to have other repercussions, too. If we can believe a recent article in eFinancialCareers, the reputation of quants has taken a real beating:

What's a PhD with a bias towards quantitative finance to do? Banks have gone from screaming from the rooftops that they want quants, to whispering that they're only interested in a select handful of them. This leaves a lot of people on the sidelines.

Not only are fewer quantitative models being built, but firms are getting a lot more picky about their background. According to one recruiter, PhDs will still be needed to work on less lucrative algorithmic trading work, but funds are looking for "people experienced with dealing with noisy high frequency data sets, rather than the physicists and stochastic calculus experts previously sought after by banks."

In hindsight, it seems inevitable that financial risk models and the people designing them would have to take into account the larger social and economic context of the data. To me the whole episode should be viewed as a cautionary tale for all would-be model makers. Whether you're designing climate simulations, aircraft wings or designer drugs, it's always healthy questioning the applicability of the math. The fate of people's lives and livelihoods may hinge on such skepticism.

Posted by Michael Feldman - February 26 @ 4:55PM

(Digg, Technorati, more)

Discussion

There are 1 discussion items posted.  

Debt consolidation
Submitted by EliasV on 04/21/2009 - 9:26PM


This is article is good. Since it focuses in the financial risk models that people designed that would have to take into account the larger social and economic context of the data. Whether they’ve been designing climate simulations, aircraft wings or designer drugs, it's always healthy questioning the applicability of the math, because sometimes the fate of people's lives and livelihoods may hinge on such skepticism. In relation to financial risks, using payday loans is far better than adding fuel to the fire with credit cards. Credit card interest adds up easily. If they are what got you into trouble in the first place then you might want to lay off the cards. It's better to use installment loans then make the problem worse after you begin debt consolidation. And one of the first things you should do if you enter into debt consolidation is to stop using credit if at all possible.

Post #1

Michael Feldman

Michael Feldman is the editor of HPCwire.

More Michael Feldman



Recent Comments

Compairson to Core i7-980X by rsingle

HPC? not so much by ewahl

Re: IBM and HPC by truly64

HPC = servers but a lot more by lawries

Multi core deployment becomes a memory game by truly64

Re: Venture Capital Drought? Not So Much. by Ron Van Holst

Re: Podcast: Cray Awarded Defense Deal; SGI Makes Storage Buy; IBM Invents New Algorithm by Nastyanna

Painful Truth by jeffrey.mcallister

SGI = graphics + HPC by johnbarr

HPC = servers but a lot more by truly64

Oracle SPARC != Fujitsu SPARC by Alan M. Feldstein

Sun & HPC != Oracle & HPC by Merblich

a third vendor for lossless low latency 10GbE fabric by lee.fisher@hp.com

Response to GAH by KevinButerbaugh

Response to KevinButerbaugh by GAH

Response to KevinButerbaugh by GAH

Response to GAH by KevinButerbaugh

Response to bdrupp by KevinButerbaugh

Climate Crisis and Exaflops by bdrupp

Climate Crisis and Exaflops by John Hules

Climate Crisis and Exaflops by GAH

Climate Crisis by KevinButerbaugh

IBM "Brain Simulation" article is not properly presented. by Merritt

563 out of 1206 by vvolkov

Little Iron by gadunk

At least it's not "cloud" by KevinButerbaugh

Native QPI Interface? by commike

Mmmmmm by hellcats

New transistorized IC chip scales. by symmecon

Itanium at IDF by Alan M. Feldstein

Communication time by jnapper

"The financial meltdown and computing" by donpellegrino

Human Models by mdgabriel

High-End SPARC Chip for Scientific Applications by Alan M. Feldstein

RapidMind by Mr LolO

Rapidmind by dminor

Longer run times by JohnWest

re: Algo trading Angst by jshore

Results of Testing by in_the_crease

Feature Articles

The Week in Review

C-DAC announces plans for a petaflop system; IBM researchers are working on vertical integration techniques to extend Moore's Law another 15 years. We recap those stories and more in our weekly wrapup.
Read More...

Moscow State University Supercomputer Has Petaflop Aspirations

The Moscow State University supercomputer, Lomonosov, has been selected for a high-performance makeover, with the goal of tripling its processing power to achieve petaflop-level performance in 2010. T-Platforms, who developed and manufactured the supercomputer, is the odds-on favorite to lead the project.
Read More...

Intel Ups Performance Ante with Westmere Server Chips

Right on schedule, Intel has launched its Xeon 5600 processors, codenamed "Westmere EP." The 5600 represents the 32nm sequel to the Xeon 5500 (Nehalem EP) for dual-socket servers. Intel is touting better performance and energy efficiency, along with new security features, as the big selling points of the new Xeons.
Read More...

Top Headlines

Australia Commissions Cray Supercomputer

Mar 19 | OfficialWire | New super to support intelligence work Down Under. Read more...

Intel Partners See 'Easy' Upgrade Path With Xeon 5600 Chips

Mar 18 | ChannelWeb | Westmere parts already showing up in HPC machines. Read more...

AMD: OEMs primed for Opteron 6100s

Mar 17 | The Register | But what about the tier ones? Read more...

Arrival of the Desktop Supercomputer

Mar 17 | Cadalyst Magazine | A new generation of workstations is changing the nature of technical computing. Read more...

Scheduling HPC In The Cloud

Mar 17 | Linux Magazine | Latest iteration of Sun Grid Engine able to tap into Cloud. Read more...

Featured Whitepapers

Virtualization for Aggregation And The vSMP Architecture™

Jan 12 | | In-depth look at vSMP Foundation server virtualization technology, technical implementation, use cases and capabilities. The technical whitepaper provides an architectural overview and details on the three vSMP Foundation products: vSMP Foundation for SMP, vSMP Foundation for Cluster and vSMP Foundation for Cloud.

Copper Cable Technologies for High Performance Computing

Jan 18 | | This white paper discusses Gore’s copper cable assemblies, and how they continue to exceed the standards for providing reliable, cost-effective solutions for high-performance computer applications.

Multimedia

Webcast: Virtualized Data Center Roundtable

Join this online panel discussion for live Q&A with leading industry experts, analysts, and end-users to discuss the latest innovations, best practices, barriers to implementation, and measurable benefits of server virtualization with a particular focus on today's real world solutions.

Webcast: Watch SC09 Birds of a Feather Video: Scalable Fault-Tolerant HPC Supercomputers

Learn about scalable fault-tolerant architectures and examples of energy efficient and scalable supercomputing clusters using dual QDR InfiniBand to combine capacity computing with network failover capabilities with the help of programming languages such as MPI and a robust Linux cluster management package.

Webcast: High Performance Computing for a Smarter Planet

LIVE@SCO9: The IBM team discusses new innovations in hardware, software and services that help clients better understand their workloads and get insight from their R&D efforts. Technology demonstrations include the soon-to-be-released Power7 HPC processor, the DCS990 system with 2.4 petabytes of storage, the xCAT management tool, secure HPC cloud computing and more. Winners of two HPCwire Readers' and Editors’ Choice Awards! Take the IBM virtual tour at SC09 or more information go online to: http://www-03.ibm.com/systems/deepcomputing/sc09.html

Blogs by Topics

Blogs by Author

HPC Blogroll



Featured Events

HPC User Forum DICE
2010 High Performance Computing Linux Financial Markets
Cloud Computing Expo
Cloud Lab
ESC
DEISA PRACE Symposium