The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
September 02, 2008
Look at all the current research projects aimed at exactly that: making parallel programming easy!
The NESL language aims to "make parallel programming easy and portable." More precisely, its goal is to allow programmers "to write parallel code as concisely and clearly as sequential code, while achieving close to peak performance."
Microsoft's Parallel Computing Platform team aims to provide a runtime that provides support for parallelism, models, libraries and tools that "make it easy for developers to construct correct, efficient, maintainable and scalable parallel programs."
The CxC (C by C) language has one-sided communication operations, "which makes parallel programming easy and efficient."
My alma mater, the University of Illinois, has a new Universal Parallel Computing Research Center, whose goal is simply "Making parallel programming easy." Marc Snir, the Computer Science Department head, said the goal for this effort is to "make 'parallel programming' synonymous with 'programming'."
The Parallel Computing Lab at the University of California at Berkeley has adopted the goal to "make it easy to write correct programs that run efficiently on manycore systems, and which scale as the number of cores doubles every two years."
Intel's Threaded Building Blocks (TBB) extends C++ for parallelism in an easy to use and efficient manner.
Tim Mattson (Intel) points out that in "our quest to find that perfect language to make parallel programming easy," we have come up with an alarming array of parallel programming choices: MPI, OpenMP, Ct, HPF, TBB, Erlang, Shmem, Portals, ZPL, BSP, CHARM++, Cilk, Co-array Fortran, PVM, Pthreads, Windows threads, Tstreams, GA, Java, UPC, Titanium, Parlog, NESL, Split-C, and on and on.
Tim and I are colleagues on the OpenMP Language committee, which recently finalized the OpenMP 3.0 standard. OpenMP's mission is to define a "portable, scalable model that gives shared-memory parallel programmers a simple and flexible interface for developing parallel applications for platforms ranging from the desktop to the supercomputer." Is simple even easier than easy?
Every time I see someone claiming they've come up with a method to make parallel programming easy, I can't take them seriously. First, "making parallel programming easy" must be harder than "making programming easy," and I don't think we've reached that first milestone yet. Yes, I can (and do) knock off quick programs to search or compute something simple, but then I can knock off a quick project to build a bridge over the seasonal stream in our backyard, too. I wouldn't trust that bridge to freeway traffic, and I wouldn't trust that quick program to solve anyone else's problem, either.
Page: 1 of 4(Digg, Technorati, more)
Jul 01 | GenomeWeb Daily News | The popularity of cloud computing in the life sciences community was on full display at April's Bio-IT World conference. Read more...
Jul 01 | Linux Magazine | How can getting to the ocean help with HPC computing? Read more...
Jun 29 | GCN.com | Agency issues RFI for "Ubiquitous High Performance Computing" systems. Read more...
Jun 29 | Computerworld | The bottom of the TOP500 reveals the coming revolution in truly accessible high-end computing. Read more...
Jun 18 | EE Times | Parallel software also takes spotlight at Stanford confab. Read more...
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.