RapidMind Looks to Tame the Multicore Beast

By Michael Feldman

May 11, 2007

Hot on the heels of PeakStream, RapidMind Inc. has launched its software development platform for multicore computing. On Monday the company announced RapidMind Platform v2.0, a software environment that targets GPUs from both NVIDIA and AMD/ATI as well as IBM's Cell processor. The company has also prototyped a version that will support multicore x86 processors from Intel and AMD.

Both PeakStream and RapidMind have launched platforms based on the same basic premise: HPC application developers want to be able to write hardware-agnostic code for multicore architectures. Considering the diverse range of multicore hardware that is beginning to populate HPC systems (e.g,, the Cell processors, NVIDIA/AMD GPUs, and Intel/AMD x86 chips), this seems like the right approach. The underlying proposition is that the current crop of multicore devices will rapidly evolve in both architecture and core count. With this type of volatility, software developers will be motivated to decouple their code from the hardware so that their applications can live on different types of architectures and automatically scale as new processor generations are introduced.

In talking with RapidMind's President and CEO Ray DePaul, and Chief Scientist and company co-founder Michael McCool, it's clear that their vision of delivering productivity to these multicore-based systems is to move beyond the thread model of parallelism. McCool said programmer-controlled thread management is fraught with problems. The scalability issue of mapping static application thread counts to processor cores is always a problem if application portability is a goal. Beyond that there are the inherent dangers of deadlocks and race conditions and load balancing problems when the thread workloads are asymmetric.

The RapidMind Platform uses existing C++ compilers and tools; developers just have to link in the RapidMind library to access the provided API. The library manages all the low-level parallelism and data streaming. The programming model presented to the user is independent of the number or cores or any other specific hardware attributes. The parallelism and data movement are managed in the internal layers of the software. According to McCool, this makes it impossible for developers to generate race conditions or deadlocks. He claims that the programming concepts involved can be learned within half an hour by any good software engineer.

The company has supposedly attracted over 1000 beta developers for applications that range from medical imaging to financial analysis and spam filtering. RTT USA is already using RapidMind's platform to develop commercial 3D real-time visualization applications for the automotive, aircraft and consumer-goods industries.

RapidMind's model, like PeakStream's, is geared for data-level parallelism. It's described as an SPMD (Single Program Multiple Data) stream processing model, where different cores execute the same instructions, with each core working on different data. Using the platform's API, developers define functions that are applied to data arrays. At runtime, the system software automatically distributes the data operations across the different processing elements.

The rationale for this approach has to do with the dichotomy between computation and memory performance. While it is relatively straightforward to add more cores as process technology shrinks, memory bandwidth to feed those cores is not increasing nearly as fast. McCool said the RapidMind software works very hard to optimize data movement so that memory latencies are hidden and RAM accesses are performed efficiently. The RapidMind system also includes load balancing to move work around so that all the cores are used efficiently.

“The system is highly tuned toward making sure that memory transfers overlap with computations, and that the data stays on-chip as long as possible and you get as much work done before the data goes off-chip again,” explained McCool.

Given the high level of parallelism inherent in processors like the Cell and GPUs, these architectures are particularly well-suited for this type of stream computing model. The Cell contains nine cores: a PowerPC core and eight Synergistic Processing Units (SPUs). And as long as you're not in the market for double-precision support, NVIDIA and AMD GPUS support even greater parallelism. The latest NVIDIA G80 device encompasses 128 cores. But as DePaul stated, “the challenge has always been how the developer can take advantage of these accelerator-type models.”

HPC programmers are all for removing complexity — as long as you don't remove the performance too. RapidMind presented some benchmarks to show they are delivering the expected performance when using GPUs for acceleration. Running an application based on the Black-Scholes algorithm, the company was able to show a 32x performance speedup on an NVIDIA 7900 GTX compared to the same application running on a Woodcrest Xeon workstation. They also showed a 2x performance increase for a BLAS routine SGEMM application, and 3x increase for an FFT workload. The results are not too surprising considering the single-precision floating point performance advantages of a high-end GPU versus a high-end CPU.

More impressive were the results they got when comparing a (Quaternion Julia Set) renderer application on the Cell processor. On code that was tuned by both IBM and RapidMind engineers for the same Cell platform, RapidMind outperformed the IBM's Cell SDK implementation by almost a factor of two. The renderer algorithm itself was relatively simple. The complex part, at least for the IBM developers, was targeting the code to the Cell platform.

DePaul noted this wasn't a matter of the developer not being good enough (we assume the IBM Cell programmers know how their own hardware works). He said there is so much complexity involved in making sure that the eight SPU cores, the DMA transfers and memory latency are all coordinated, that it's hard for mere humans to deal with all the interactions.

RapidMind currently supports the NVIDIA GeForce 6000, 7000 or 8000 cards, the NVIDIA Quadro card, and the ATI x1X00 family of cards. The Cell BE processor is supported on the IBM QS20/30 blade and the Sony PlayStation3 using Yellow Dog Linux. (If you've got an idle PlayStation3 lying around, you can download the RapidMind Developer Edition for free at http://www.rapidmind.net.)

Support for the Intel and AMD multicore x86 processors is in the works. A prototype of this software was able to achieve an 8x improvement in performance on a quad-core Intel Xeon versus a single-core implementation on the same platform. The interesting aspect here is that the RapidMind implementation was apparently able to double the application performance per core by exploiting parallelism that the compiler alone couldn't extract.

The company plans to use its recent $10 million funding infusion to bring the x86 multicore support capability to market and to expand the sales and marketing crew. Future plans to support other architectures will be based on customer demand.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion XL — were added to the benchmark suite as MLPerf continues Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing power it brings to artificial intelligence.  Nvidia's DGX Read more…

Call for Participation in Workshop on Potential NSF CISE Quantum Initiative

March 26, 2024

Editor’s Note: Next month there will be a workshop to discuss what a quantum initiative led by NSF’s Computer, Information Science and Engineering (CISE) directorate could entail. The details are posted below in a Ca Read more…

Waseda U. Researchers Reports New Quantum Algorithm for Speeding Optimization

March 25, 2024

Optimization problems cover a wide range of applications and are often cited as good candidates for quantum computing. However, the execution time for constrained combinatorial optimization applications on quantum device Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at the network layer threatens to make bigger and brawnier pro Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HBM3E memory as well as the the ability to train 1 trillion pa Read more…

MLPerf Inference 4.0 Results Showcase GenAI; Nvidia Still Dominates

March 28, 2024

There were no startling surprises in the latest MLPerf Inference benchmark (4.0) results released yesterday. Two new workloads — Llama 2 and Stable Diffusion Read more…

Q&A with Nvidia’s Chief of DGX Systems on the DGX-GB200 Rack-scale System

March 27, 2024

Pictures of Nvidia's new flagship mega-server, the DGX GB200, on the GTC show floor got favorable reactions on social media for the sheer amount of computing po Read more…

NVLink: Faster Interconnects and Switches to Help Relieve Data Bottlenecks

March 25, 2024

Nvidia’s new Blackwell architecture may have stolen the show this week at the GPU Technology Conference in San Jose, California. But an emerging bottleneck at Read more…

Who is David Blackwell?

March 22, 2024

During GTC24, co-founder and president of NVIDIA Jensen Huang unveiled the Blackwell GPU. This GPU itself is heavily optimized for AI work, boasting 192GB of HB Read more…

Nvidia Looks to Accelerate GenAI Adoption with NIM

March 19, 2024

Today at the GPU Technology Conference, Nvidia launched a new offering aimed at helping customers quickly deploy their generative AI applications in a secure, s Read more…

The Generative AI Future Is Now, Nvidia’s Huang Says

March 19, 2024

We are in the early days of a transformative shift in how business gets done thanks to the advent of generative AI, according to Nvidia CEO and cofounder Jensen Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Nvidia Showcases Quantum Cloud, Expanding Quantum Portfolio at GTC24

March 18, 2024

Nvidia’s barrage of quantum news at GTC24 this week includes new products, signature collaborations, and a new Nvidia Quantum Cloud for quantum developers. Wh Read more…

Alibaba Shuts Down its Quantum Computing Effort

November 30, 2023

In case you missed it, China’s e-commerce giant Alibaba has shut down its quantum computing research effort. It’s not entirely clear what drove the change. Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

DoD Takes a Long View of Quantum Computing

December 19, 2023

Given the large sums tied to expensive weapon systems – think $100-million-plus per F-35 fighter – it’s easy to forget the U.S. Department of Defense is a Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Leading Solution Providers

Contributors

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

Google Introduces ‘Hypercomputer’ to Its AI Infrastructure

December 11, 2023

Google ran out of monikers to describe its new AI system released on December 7. Supercomputer perhaps wasn't an apt description, so it settled on Hypercomputer Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Intel Won’t Have a Xeon Max Chip with New Emerald Rapids CPU

December 14, 2023

As expected, Intel officially announced its 5th generation Xeon server chips codenamed Emerald Rapids at an event in New York City, where the focus was really o Read more…

IBM Quantum Summit: Two New QPUs, Upgraded Qiskit, 10-year Roadmap and More

December 4, 2023

IBM kicks off its annual Quantum Summit today and will announce a broad range of advances including its much-anticipated 1121-qubit Condor QPU, a smaller 133-qu Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire