Tracking Trends in the Top Supercomputers

By Tim Curns, Editor

June 24, 2005

If there's one thing you can tell by looking at the newest list of the most powerful (read fastest) supercomputers in the world, it's that some real change is taking place in the HPC field. Five of the top 10 systems are new to the list, and over 200 smaller systems from last November's rankings have been eclipsed by faster ones.

As expected, IBM kept its lead position with the BlueGene/L System, a joint development of IBM and DOE's National Nuclear Security Administration (NNSA). The system is installed at DOE's Lawrence Livermore National Laboratory in Livermore, CA. This same system also nabbed the top spot last November, but has since doubled in size and reached a new record Linpack benchmark performance of 136.8 TFlop/s.

IBM's leadership further increased due to six of its systems now ranking in the top 10. Five of these systems use the Blue Gene design. The new No. two listed system is an IBM Blue Gene system with the same architecture but smaller in size than the No. one BlueGene/L at LLNL. It was recently installed at IBM's Thomas J.Watson Research Center in Yorktown, N.Y. and reached 91.2 TFlop/s.

“The latest list, particularly if you look at the top 10, clearly illustrates the dynamic nature of supercomputing today. In just one year, we have seen a dramatic turnover from a ranking topped by the Earth Simulator followed by a number of clusters and two prototypes of IBM's Blue Gene,” said Erich Strohmaier, one of the founding editors of the list and a computer scientist at Lawrence Berkeley National Laboratory. “Today, we see that Blue Gene has gained the first two positions and occupies five of the top 10 slots.”

Some analysts agree that IBM has solidified its lead as a clear HPC powerhouse.

“IBM's general strategy of delivering solutions based on a wide variety of in- house and OEM technologies also succeeds at the top end of the IT food chain,” said Charles King, principal analyst at Pund-IT Research. “While a number of competitors argue vociferously against the wisdom of the company's efforts, IBM's latest Top500 success offers something for them to chew on along with their humble pie,” he continued.

SGI's Columbia system at the NASA Ames Research Center in Mountain View, CA dropped one spot to No. three. Columbia clocked in at 51.87 TFlop/s. The NEC-built Earth Simulator, which has a Linpack benchmark performance of 35.86 TFlop/s and had held the No. one position for five consecutive TOP500 lists before being replaced by BlueGene/L last November, is now shown as No. four.

Intel also had a good showing on the list; 333 of the world's top 500 systems on the list have Intel processors inside. Five years ago only four systems on the list were Intel-based.

According to King, HP had the weakest showing since before its acquisition of Compaq, though after IBM, HP sells the bulk of systems at all performance levels of the TOP500. The company's major management changes and replacement of its RISC platforms may have contributed to its poor showing. However, customers are slowly adopting HP's Itanium-based products, making the company a potential force in the future.

Analysts are optimistic about the trends that seem to be appearing with the 25th list.

“From the standpoint of IT evolution, this newest list demonstrates impressive gains over the past half year, with entry-level systems now offering nearly 1/3 better performance than those just six months ago,” said Charles King. “In addition, faster systems replaced half of the top ten and over 40 percent of last November's list. This breathtaking performance boost offers a good deal to consider at the stratospheric limits of computing, but it also underlines another fact: the evolution of supercomputing as an increasingly pervasive entity across a broadening range of commercial applications,” he stated.

“This new list also demonstrates that clustered systems are continuing to replace traditional monolithic supercomputing systems. As this trend accelerates, and every indication suggests it will, the influence of supercomputing will expand across an ever widening range of commercial and consumer markets.”

Linux analyst Stacey Quandt, Quandt Analytics, seemed to agree. “The overall advancements in semiconductor and interconnect technology in the supercomputer realm will in time reap benefits for customers running 'real-world' applications.

The semi-annual TOP500 list of supercomputers is the work of Hans Meuer of the University of Mannheim, Erich Strohmaier and Horst Simon of the U.S. Department of Energy's National Energy Research Scientific Computing Center, and Jack Dongarra of the University of Tennessee.

Despite the bragging rights it provides, the Linpack benchmark and TOP500 list are generally thought to be insufficient indicators of actual application performance.

“The TOP500 is a pretty narrow perspective,” said Richard Partridge, VP of Enterprise Servers, Ideas International. “We've been arguing about Linpack for decades now. Clearly Linpack is a theoretical peak kind of metric. But it is easy to measure and has been measured for decades. Therefore, it has the great advantage of continuity — being able to bridge between the champions of old and today's high-end systems,” he said.

Partridge went on to say that the HPC community will need to look at more than just list placement. He suggested that the HPC Challenge might be a more comprehensive procedure to judge a system's true performance.

Though Linpack may not be the best way to judge a supercomputer's true capability, it is easy to conduct and comprehendible to more people in the field, rather than just experts.

“I don't think there's anybody who champions Linpack as being superb, but I don't think that anybody's come up with a simple, one numerical kind of number that can replace Linpack,” said Partridge. “I'm not sure that I would worry about who is number three and number 13 and number 23, as much as…what kind of trends do you see?”

The semi-annual list, regardless of all its possible shortcomings, cannot be ignored. Here are some other trends that stand out from the rankings.


  • As predicted several years ago by the research team behind the TOP500 listing, only systems exceeding the 1 TFlop/s mark on the Linpack were qualified to enter the list this time. The system in No. 500 spot reached 1.166 TFlop/s.
  • The entry level for the TOP10 exceeds 15 TFlop/s and the entry point for the top 100 moved from 2.026 TFlop/s to 3.412 TFlop/s.
  • Entry level for the TOP500 is now 1.166 TFlop/s, compared to 850.6 GFlop/s six months ago. The last system on the list would have been listed at position 299 in the last TOP500 just six months ago. This exemplifies the continuous rapid turnover of the TOP500.
  • The last system (#500) in June 2005 has about the same compute power as ALL 500 systems combined, when the list was first created 13 years ago in June1993.
  • Total combined performance of all 500 systems on the list is now 1.69 PFlop/s (“petaflops” or thousand “teraflops”), compared to 1.127 PFlop/s six months ago.

Other trends of interest:

  • A total of 333 systems are now using Intel processors. Six months ago there were 320 Intel-based systems on the list and one year ago only 287. The second most-commonly used processors are the IBM Power processors (77 systems), ahead of Hewlett-Packard's PA Risc processors (36) and AMD processors (25).
  • There are 304 systems now labeled as clusters, making this the most common architecture in the TOP500.
  • At present, IBM and Hewlett-Packard sell the bulk of systems at all performance levels of the TOP500. IBM remains the clear leader in the TOP500 list with 51.8 percent of systems and 57.9 percent of installed performance. HP is second with 26.2 percent of systems and 13.3 percent of performance and SGI is third with 5 percent of systems and 7.45 percent of performance. No other manufacturer is able to capture more than 5% in any category.
  • The U.S is clearly the leading consumer of HPC systems with 294 of the 500 systems installed there (up from 267 six months ago). A new geographical trend, which started a few years ago, now emerges more clearly. The number of systems in Asian countries other than Japan is rising quite steadily. In this latest list, Japan is listed with 23 systems and all other Asian countries combined have an additional 58 systems. However Europe is still ahead of Asia, with 114 systems installed.
  • China is home to 19 of the systems in Asia — up from 17 systems six months ago.
  • In Europe, Germany claimed the No. 1 spot from UK again, with 40 systems compared to 32. Six months ago, UK was in the lead with 42 compared to Germany's 35 systems.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week!

Anders Dam Jensen on HPC Sovereignty, Sustainability, and JU Progress

April 23, 2024

The recent 2024 EuroHPC Summit meeting took place in Antwerp, with attendance substantially up since 2023 to 750 participants. HPCwire asked Intersect360 Research senior analyst Steve Conway, who closely tracks HPC, AI, Read more…

AI Saves the Planet this Earth Day

April 22, 2024

Earth Day was originally conceived as a day of reflection. Our planet’s life-sustaining properties are unlike any other celestial body that we’ve observed, and this day of contemplation is meant to provide all of us Read more…

Intel Announces Hala Point – World’s Largest Neuromorphic System for Sustainable AI

April 22, 2024

As we find ourselves on the brink of a technological revolution, the need for efficient and sustainable computing solutions has never been more critical.  A computer system that can mimic the way humans process and s Read more…

Empowering High-Performance Computing for Artificial Intelligence

April 19, 2024

Artificial intelligence (AI) presents some of the most challenging demands in information technology, especially concerning computing power and data movement. As a result of these challenges, high-performance computing Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that have occurred about once a decade. With this in mind, the ISC Read more…

2024 Winter Classic: Texas Two Step

April 18, 2024

Texas Tech University. Their middle name is ‘tech’, so it’s no surprise that they’ve been fielding not one, but two teams in the last three Winter Classic cluster competitions. Their teams, dubbed Matador and Red Read more…

Anders Dam Jensen on HPC Sovereignty, Sustainability, and JU Progress

April 23, 2024

The recent 2024 EuroHPC Summit meeting took place in Antwerp, with attendance substantially up since 2023 to 750 participants. HPCwire asked Intersect360 Resear Read more…

AI Saves the Planet this Earth Day

April 22, 2024

Earth Day was originally conceived as a day of reflection. Our planet’s life-sustaining properties are unlike any other celestial body that we’ve observed, Read more…

Kathy Yelick on Post-Exascale Challenges

April 18, 2024

With the exascale era underway, the HPC community is already turning its attention to zettascale computing, the next of the 1,000-fold performance leaps that ha Read more…

Software Specialist Horizon Quantum to Build First-of-a-Kind Hardware Testbed

April 18, 2024

Horizon Quantum Computing, a Singapore-based quantum software start-up, announced today it would build its own testbed of quantum computers, starting with use o Read more…

MLCommons Launches New AI Safety Benchmark Initiative

April 16, 2024

MLCommons, organizer of the popular MLPerf benchmarking exercises (training and inference), is starting a new effort to benchmark AI Safety, one of the most pre Read more…

Exciting Updates From Stanford HAI’s Seventh Annual AI Index Report

April 15, 2024

As the AI revolution marches on, it is vital to continually reassess how this technology is reshaping our world. To that end, researchers at Stanford’s Instit Read more…

Intel’s Vision Advantage: Chips Are Available Off-the-Shelf

April 11, 2024

The chip market is facing a crisis: chip development is now concentrated in the hands of the few. A confluence of events this week reminded us how few chips Read more…

The VC View: Quantonation’s Deep Dive into Funding Quantum Start-ups

April 11, 2024

Yesterday Quantonation — which promotes itself as a one-of-a-kind venture capital (VC) company specializing in quantum science and deep physics  — announce Read more…

Nvidia H100: Are 550,000 GPUs Enough for This Year?

August 17, 2023

The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more…

Synopsys Eats Ansys: Does HPC Get Indigestion?

February 8, 2024

Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more…

Intel’s Server and PC Chip Development Will Blur After 2025

January 15, 2024

Intel's dealing with much more than chip rivals breathing down its neck; it is simultaneously integrating a bevy of new technologies such as chiplets, artificia Read more…

Choosing the Right GPU for LLM Inference and Training

December 11, 2023

Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more…

Baidu Exits Quantum, Closely Following Alibaba’s Earlier Move

January 5, 2024

Reuters reported this week that Baidu, China’s giant e-commerce and services provider, is exiting the quantum computing development arena. Reuters reported � Read more…

Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads?

October 30, 2023

With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it’s a new GPU optimized for AI and g Read more…

Shutterstock 1179408610

Google Addresses the Mysteries of Its Hypercomputer 

December 28, 2023

When Google launched its Hypercomputer earlier this month (December 2023), the first reaction was, "Say what?" It turns out that the Hypercomputer is Google's t Read more…

AMD MI3000A

How AMD May Get Across the CUDA Moat

October 5, 2023

When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more…

Leading Solution Providers

Contributors

Shutterstock 1606064203

Meta’s Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs

January 25, 2024

In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more…

China Is All In on a RISC-V Future

January 8, 2024

The state of RISC-V in China was discussed in a recent report released by the Jamestown Foundation, a Washington, D.C.-based think tank. The report, entitled "E Read more…

Shutterstock 1285747942

AMD’s Horsepower-packed MI300X GPU Beats Nvidia’s Upcoming H200

December 7, 2023

AMD and Nvidia are locked in an AI performance battle – much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more…

Nvidia’s New Blackwell GPU Can Train AI Models with Trillions of Parameters

March 18, 2024

Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more…

Eyes on the Quantum Prize – D-Wave Says its Time is Now

January 30, 2024

Early quantum computing pioneer D-Wave again asserted – that at least for D-Wave – the commercial quantum era has begun. Speaking at its first in-person Ana Read more…

GenAI Having Major Impact on Data Culture, Survey Says

February 21, 2024

While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more…

The GenAI Datacenter Squeeze Is Here

February 1, 2024

The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more…

Intel’s Xeon General Manager Talks about Server Chips 

January 2, 2024

Intel is talking data-center growth and is done digging graves for its dead enterprise products, including GPUs, storage, and networking products, which fell to Read more…

  • arrow
  • Click Here for More Headlines
  • arrow
HPCwire