The Leading Source for Global News and Information Covering the Ecosystem of High Productivity Computing
July 24, 2008
On Tuesday at the O'Reilly Open Source Convention (OSCON), Intel announced that the latest version of its Threading Building Blocks (TBB) library, version 2.1, will be available for download this week. TBB is Intel's contribution to the growing collection of tools designed to help the millions of programmers worldwide exploit parallelism in their applications.
Intel doesn't make its money making chips -- it makes its money making chips that do things people want done. Ultimately this means creating hardware that programmers can use to make their software applications tumble, twirl, and pirouette across the computer desktops of users from Monterey to Minsk. This means that when Intel makes a big architectural change, like the one we are currently experiencing with the introduction of multicore processors, it is in the company's best interest to help developers manage the change effectively.
A traditional threaded approach to programming that uses, for example, POSIX or Windows threads requires the programmer to manually create and manage the threads used by an application. Managing threads explicitly can be a laborious and error-prone process that challenges even experienced programmers. For those new to parallelism
That's where Threading Building Blocks, or TBB, comes in. TBB is a C++ template library designed to help programmers express the parallelism hiding in their applications in a way that separates expression from implementation, and without having to worry about thread management details. TBB allows the programmer to focus on managing tasks in the application. The library's run time engine then handles the scheduling of tasks to threads so that the programmer doesn't have to, using a work stealing approach that ensures the computational demand on each core stays balanced even in the face of dynamic system load.
Where does it fit in the box of tools available to C++ programmers? TBB is discussed most frequently in the context of POSIX or other native threads implementation and OpenMP.
Compared to parallelism using native threads, TBB offers the advantages already discussed in avoiding the need for the programmer to explicitly manage the threads. For the most part, native threads require that work be assigned to threads through functions and, for users programming in C++ (but not C or Fortran), using native threads may pose challenges that disrupt the flow of the program. TBB is also well-suited to applications with a lot of parallel work that needs to be done that isn't expressed in a loop structure, and it emphasizes scalability through data parallel programming.
Unlike OpenMP, neither native threads nor TBB requires compiler support. The use of C++ templates means that TBB is available anywhere there is a C++ compiler, and it fits in nicely with object-oriented programming. For applications written in C or Fortran, OpenMP may still be a great solution because it fits well into a structured programming style. (See the examples in this paper for an illustration of how disruptive TBB can be if it doesn't fit the programming style.) This is especially true if the application is dominated by loop-based processing, where OpenMP really shines. Both OpenMP and TBB are portable, and both adapt easily to spread work to be done over available resources. Native threads share neither of these advantages.
Interestingly all three methods can co-exist in an application, as can MPI, making it straightforward to adopt the model that's best suited to the work in a particular area of the code -- provided you have the necessary programming skills.
There are two versions of TBB: a commercial version, available in shrink wrap from Intel, and the open source version, announced at OSCON last year. I spoke with Intel's Phil De La Zerda and Vasanth Tovinkere about what's new in this latest version of the library, and both men emphasized the degree to which the new release benefits from the input of a large and active community on the open source side. Phil is Intel's director of business development, developer products division and Vasanth is a senior staff engineer in Intel's performance, analysis and threading lab.
Intel created TBB to provide a robust path to parallel programming for those without a lot of experience in traditional high-end HPC. And Intel has been pleased with its success so far. According to De La Zerda, TBB is included in about 60 percent of Linux distributions that have been paid for, and 80 percent of free distributions. These distributions cover OpenSolaris, Fedora, OpenSuse, Ubuntu, and many others. While De La Zerda declined to be specific on Intel's download goals, he did mention that in the year since TBB was open sourced, downloads were "in the many thousands," and the actual numbers more than doubled their original expectations.
Page: 1 of 2(Digg, Technorati, more)
New Paper: Parallel Computing Without Parallel Programming
Learn how domain experts can run VHLL programs like MATLAB® on a variety of high-performance platforms without low-level reprogramming and how to work with the largest datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Spider, the world's biggest Lustre-based, centerwide file system, has been fully tested to support Oak Ridge National Laboratory's new petascale Cray XT4/XT5 Jaguar supercomputer and is now offering early access to scientists.
Read More...
Wolfram Alpha, the Web-based computational engine introduced in May, is not a traditional supercomputing application, but relies on supercomputers to satisfy its unique requirements.
Read More...
There was a new energy at this year's TeraGrid '09 conference thanks to an outstanding turnout for the student program. Thanks to support from the National Science Foundation, more than 100 high school, undergraduate and graduate students were able to participate in the conference.
Read More...
Jul 09 | Engineer Live | The demand for computational tools to underpin the 3D seismic interpretation process has never been more apparent. Read more...
Jul 08 | EE Times | Unemployment for U.S. engineers has reached record levels, according to government figures. Read more...
Jul 08 | Network World | Global spending for 2009 projected to drop 6 percent, for a total of $3.2 trillion. Read more...
Jul 08 | Linux Magazine | Portability or efficiency? Neither is guaranteed when writing explicit parallel code. Read more...
Jul 07 | Ars Technica | Japanese company builds custom ASIC to accelerate real-time ray traced rendering for the auto industry. Read more...
Jul 10 | | Engineers, scientists, and other domain experts depend on the productivity enabled by very high-level language (VHLL) tools like MATLAB® and Python. However, as datasets grow larger and programs get more sophisticated, ordinary desktop computers can no longer keep up. The paper explores how to run VHLL programs on high-performance platforms without low-level reprogramming. Work with large datasets and complex algorithms without sacrificing ease of use or reducing productivity.
Apr 14 | | Many HPC IT departments are feeling the rising pressure to deliver more capacity computing and performance while trying to reduce the total cost of ownership. This white paper discusses how an environmentally-friendly and open-standards HPC building block based computing system using flexible interconnect options helps address capacity computing needs.
Source: Addison Snell, GM/VP, Tabor Research; sponsored by Dell
Many organizations that could benefit from the use of HPC clusters find that it is complicated to get the systems up and running because of limited IT resources or the complexities of the clusters themselves. Learn how the Intel Cluster Ready program, for which Dell was an original partner, seeks to address this challenge for entry level and mid-range HPC users.
BlueArc's Titan architecture represents an evolutionary step in file servers by creating a hardware-based file system that can scale bandwidth, IOPS, and overall data capacity well beyond conventional software-based devices. With its ability to virtualize a massive storage pool of up to four usable petabytes of tiered storage, Titan can scale with growing data requirements, offering a competitive advantage for businesses, researchers, or other enterprises seeking to better manage data growth while still ensuring optimal performance.
Sun Studio Compilers and Tools and Sun HPC ClusterTools allow you to create high performance parallel applications for OpenSolaris, Solaris and Linux. Sun Studio Express 11/08 includes MPI performance analysis capabilities and full OpenMP 3.0 compiler support. Learn about all this and the latest in Sun HPC ClusterTools 8.1.