September 03, 2012
Fortune writer Christopher Steiner has just released a new book called Automate This: How Algorithms Came to Rule Our World. His work discusses the prevalence of algorithms in modern society and how industries compete for the developers that create them. This is especially true on Wall Street, where deep-pocketed financial institutions place a high value on such talent. The pay scales and benefits packages for this class of developers on Wall Street far outweigh those offered by startups with venture capital funding or run-of-the-mill institutions in need of algorithmic specialists. In an interview with Fast Company, Steiner explained how the financial industry is tempting valuable coders away from other organizations that require their talents.
Steiner believes that developers who create algorithms are the “preeminent entrepreneurs of this generation.” Their ability to build something from nothing makes them a highly sought-after commodity. “Your average developer’s going to make a nice salary,” he said, “but if that person innovates with code that ‘solves a problem’ the opportunities are huge.”
These same talents are attractive to venture capital firms, because initial costs are extremely low. The product is simply an idea that transforms information into a high-value commodity. Unfortunately, enticing algorithmic chefs to join a Silicon Valley startup has become difficult given the value financial firms have placed on these individuals. Steiner says that people don’t appreciate the number of developers Wall Street has taken off the market. During similar situations in the past, Silicon Valley companies couldn’t compete with the level of compensation offered by the financial industry -- not to mention the status of working for a prestigious New York firm.
On the other hand, startups offer developers the chance to deliver a positive impact on their society. If a coder chooses to work with a company that improves the efficiency of healthcare or reduces energy consumption by double-digit percentages, they contribute to the nation’s well being. Conversely, Steiner thinks that building algorithms for a Goldman Sachs or JP Morgan has far less potential for providing social good.
Worse, something this line of work leads to seriously awful outcomes. Steiner attributes some of this to Wall Street’s culture of speed over accuracy. In classic scenarios, developers constantly test their creations, looking for defects and edge cases. He mentioned that Google tests an algorithm a hundred million times before it gets released into the market. Financial institutions are quite the opposite. Firms are so consumed with turnaround time that developers don’t have the capacity to properly vet their code. New algorithms go into production every couple of weeks, and on occasion, go rogue.
Take for example, the Flash Crash of 2010, which resulted in a 1,000-point swing on the Dow Jones industrial, and more recently, this year’s Knight’s Capital debacle, which caused the firm to lose $440 million in a single day. Both were the result of algorithms run amuck.
Full story at Fast Company
Contributing commentator, Andrew Jones, offers a break in the news cycle with an assessment of what the national "size matters" contest means for the U.S. and other nations...
Read more...
Today at the International Supercomputing Conference in Leipzing, Germany, Jack Dongarra presented on a proposed benchmark that could carry a bit more weight than its older Linpack companion. The high performance conjugate gradient (HPCG) concept takes into account new architectures for new applications, while shedding the floating point....
Read more...
Not content to let the Tianhe-2 announcement ride alone, Intel rolled out a series of announcements around its Knights Corner and Xeon Phi products--all of which are aimed at adding some options and variety for a wider base of potential users across the HPC spectrum. Today at the International Supercomputing Conference, the company's Raj....
Read more...
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?
Join our webinar to learn how IT managers can migrate to a more resilient, flexible and scalable solution that grows with the data center. Mellanox VMS is future-proof, efficient and brings significant CAPEX and OPEX savings. The VMS is available today.