China’s Indigenous Supercomputing Strategy Bears First Fruit

By Michael Feldman

November 1, 2011

If anyone wasn’t taking China seriously as a contender for supercomputing supremacy, such doubts should have been dispelled last week when the New York Times reported that the nation has deployed its first petascale supercomputer built with domestically produced CPUs. And it’s not just the processors that were homegrown. Based on a presentation delivered last month at the China’s Annual Meeting of National High Performance Computing, most of major components of the new machine were designed and built with native engineering, including the liquid cooling technology, the system network, and the software stack.

As we recapped last week, the Sunway BlueLight MPP, installed in September at the National Supercomputer Center in Jinan, is being powered by 8,704 ShenWei SW1600 processors. The resulting machine delivers just a over a petaflop of performance, with a Linpack rating of 796 teraflops. That will probably place it somewhere between 15th and 20th place on the upcoming TOP500 list, assuming the engineers at Jinan sent their submission in on time.

Impressively, its power consumption of just one megawatt will make it one of the more power-efficient of CPU-only supercomputers in the work. Running Linpack, BlueLight delivers 741 megaflops/watt, which would place it in the top ten of the current Green500, a list that ranks the energy efficiency of supercomputers.

Perhaps even more impressively, this was all accomplished with CPUs built on 65nm process technology, which is two generations behind what can be had at most of the major fabs today. According to the presentation last week, the domestic ShenWei chip is a 16-core, 64-bit RISC processor running between 0.975 – 1.2 GHz. Assuming a frequency of 1.1 GHz, the CPU will can deliver a peak double precision floating point performance of 140.8 gigaflops. Note that if the 8,704 CPUs were running at that speed, the machine would actually deliver 1.2 peak petaflops, not the claimed 1.07 petaflops. Apparently the supercomputer is equipped with processors clocked at the lower end of their frequency range.

Digging a little deeper into the specs, the CPU is a four-issue superscalar design with two integer and two floating-point execution units. The integer unit has a 7-stage pipeline, while the floating point unit is implemented as a 10-stage pipeline. The system bus is 128 bits wide.

As is the case with most CPUs nowadays, the chip contains an integrated DDR3 memory controller. It feeds the 16 cores at a rate of up to 68 GB/second, using four memory channels. Each of the machine’s CPUs is directly connected to 16 GB of memory, although the ShenWei’s maximum memory reach is a whopping 1 TB (and 8 TB for virtual memory).

The chip also contains Level 1 and Level 2 caches — 8 KB each of instruction and data for L1, and 96 KB for L2. Those are rather small by modern CPU standards, but considering the relatively large geometries of 65nm transistors, there probably wasn’t room for both large caches and lots of cores. In this case, the chip architects opted to maximize core count.

Design of the ShenWei microprocessors is being attributed to the Jiangnán Computing Research Lab, with support from the Shandong government. The chips themselves are being fabbed by “a company in Shanghai,” which plans to moves from the current 65nm process node to 45nm. According to the Wikipedia entry on the ShenWei, this is the third generation of the architecture.

The CPUs are rather densely packed in the BlueLight system. Each 1U box crams together four dual-socket motherboards, which is about two to four times the density of a typical design. Normally that would make for an uncomfortably hot enclosure, so to compensate, the system is entirely water cooled. From the pictures in the presentation, it looks like piped liquid is run through the motherboard to maximize heat dissipation.

Each node — what they refer to as a super node — consist of 256 CPUs (4,096 cores) and 4 TB of memory, providing 32.7 teraflops of peak performance. Intra-node communication is supported by a high-speed backplane, which delivers 1 terabyte/second of bandwidth.

The system network is the most conventional part of the machine, being based on QDR InfiniBand. In this case, the engineers built custom-made 256- and 324-port switches, and outfitted the connections with optical fiber. The network is a fat-tree topology and is designed for optimized routing as well as dynamic fault tolerance. It’s not clear if Mellanox or QLogic components are in the mix here, but no mention was made of third-party switch ASICs or NICs.

The software stack is attributed to Sunway, which has provided the “virtualization” management, a parallel operating system, the parallel file system, the compiler for the ShenWei CPUs, multicore math libraries, and a Java support platform. Compiler support includes the usual suspects: C, C++, and Fortran, as well as UPC and OpenMP. The requisite MPI library rounds out the software stack.

With the ShenWei CPU, China has begun the process of edging out foreign-built processors with its own designs. The BlueLight machine first supercomputer on China’s TOP100 list with homegrown CPUs. At it stands now, 85 of those systems use Intel processors, with the remaining 14 using AMD parts. It’s clearly China’s intent to reduce, or perhaps even eliminate entirely, its dependence on processors designed outside its borders — at least for its HPC needs.

In aggregate, the Chinese have built a what appears to be world-class supercomputer, designed and built without the help of any US-based chipmakers or system vendors. The Japanese, of course, accomplish this a fairly regular basis, the latest example being the K supercomputer at RIKEN. By contrast, Europe possesses only an incomplete domestic HPC industry, with system vendors like Bull relying on exogenous CPUs, interconnects, and other components. For China, a relative newcomer to the world of high-end HPC, designing and building a domestic supercomputer is a major achievement.

Should vendors be worried? Certainly chipmakers like Intel, AMD, and NVIDIA should view this development with some trepidation. Likewise for HPC system vendors such as IBM, HP, Dell and others. China is a large and growing market for high performance computing infrastructure, and if they decide to take a homegrown approach to HPC technology, that could translate into hundreds of millions of dollars per year in lost revenue for these US-based companies.

As far as the broader picture of US (and European) competitiveness in HPC capability, there is also reason for concern. A number of industry insiders believe the Chinese are determined to beat the US and other nations in the race to exaflops. Convey co-founder and chief scientist Steve Wallach is one such individual. According to him, the dense packaging, impressive performance per watt metrics, and water cooled technology of the BlueLight system are signs of serious engineering prowess on the part of the Chinese engineers.

“This is ground-up design,” Wallach told HPCwire. “They own the technology, and that’s the key.”

More importantly, he believes the technology can scale more easily than mainstream products being offered in HPC today. In particular, if the Chinese catch up (or outsource) to more advanced fab technology, the ShenWei processors could be quite formidable. According to him, compared to a 65nm die, 32nm technology would provide four times the available silicon real estate, freeing the ShenWei designers to add more cache — something Wallach believes is a weakness in the current design.

A more obvious advantage is that, rather than relying on commodity processors and commercial clusters, the Chinese government seems willing to develop processors and systems targeted specifically to HPC. The Japanese government has done this to some extent with the aforementioned K machine and the NEC vector machines, but in the US and Europe, there is no direct government support to fund HPC processors, and only piecemeal support from various agencies to design and build advanced supercomputing systems.

In that sense, the Chinese can exploit their considerable financial resources to outrun the competition if they choose to do so. And if the new ShenWei processor and the BlueLight system is an indication of a systematic strategy, then the Chinese have already made that choice.

Subscribe to HPCwire's Weekly Update!

Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week!

NSF Extends Access to Its Leadership Systems Blue Waters & Frontera

December 14, 2018

The National Science Foundation is seeking supplemental requests for access on its leadership-class computers Blue Waters and Frontera to enable "fundamental science and engineering research that would otherwise not be p Read more…

By Staff

CFD on ORNL’s Titan Simulates Cleaner, Low-MPG ‘Opposed Piston’ Engine

December 13, 2018

Pinnacle Engines is out to substantially improve vehicle gasoline efficiency and cut greenhouse gas emissions with a new motor based on an “opposed piston” design that the company hopes will be widely adopted while t Read more…

By Doug Black

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC) is procuring from Atos in two phases over the next year-an Read more…

By Tiffany Trader

HPE Extreme Performance Solutions

AI Can Be Scary. But Choosing the Wrong Partners Can Be Mortifying!

As you continue to dive deeper into AI, you will discover it is more than just deep learning. AI is an extremely complex set of machine learning, deep learning, reinforcement, and analytics algorithms with varying compute, storage, memory, and communications needs. Read more…

IBM Accelerated Insights

4 Ways AI Analytics Projects Fail — and How to Succeed

“How do I de-risk my AI-driven analytics projects?” This is a common question for organizations ready to modernize their analytics portfolio. Here are four ways AI analytics projects fail—and how you can ensure success. Read more…

Nvidia Leads Alpha MLPerf Benchmarking Round

December 12, 2018

Seven months after the launch of its AI benchmarking suite, the MLPerf consortium is releasing the first round of results based on submissions from Nvidia, Google and Intel. Of the seven benchmarks encompassed in version Read more…

By Tiffany Trader

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Nvidia Leads Alpha MLPerf Benchmarking Round

December 12, 2018

Seven months after the launch of its AI benchmarking suite, the MLPerf consortium is releasing the first round of results based on submissions from Nvidia, Goog Read more…

By Tiffany Trader

IBM, Nvidia in AI Data Pipeline, Processing, Storage Union

December 11, 2018

IBM and Nvidia today announced a new turnkey AI solution that combines IBM Spectrum Scale scale-out file storage with Nvidia’s GPU-based DGX-1 AI server to pr Read more…

By Doug Black

Mellanox Uses Univa to Extend Silicon Design HPC Operation to Azure

December 11, 2018

Call it a corollary to Murphy’s Law: When a system is most in demand, when end users are most dependent on the system performing as required, when it’s crunch time – that’s when the system is most likely to blow up. Or make you wait in line to use it. Read more…

By Doug Black

Topology Can Help Us Find Patterns in Weather

December 6, 2018

Topology--the study of shapes--seems to be all the rage. You could even say that data has shape, and shape matters. Shapes are comfortable and familiar concepts, so it is intriguing to see that many applications are being recast to use topology. For instance, looking for weather and climate patterns. Read more…

By James Reinders

Zettascale by 2035? China Thinks So

December 6, 2018

Exascale machines (of at least a 1 exaflops peak) are anticipated to arrive by around 2020, a few years behind original predictions; and given extreme-scale performance challenges are not getting any easier, it makes sense that researchers are already looking ahead to the next big 1,000x performance goal post: zettascale computing. Read more…

By Tiffany Trader

Robust Quantum Computers Still a Decade Away, Says Nat’l Academies Report

December 5, 2018

The National Academies of Science, Engineering, and Medicine yesterday released a report – Quantum Computing: Progress and Prospects – whose optimism about Read more…

By John Russell

Revisiting the 2008 Exascale Computing Study at SC18

November 29, 2018

A report published a decade ago conveyed the results of a study aimed at determining if it were possible to achieve 1000X the computational power of the the Read more…

By Scott Gibson

Quantum Computing Will Never Work

November 27, 2018

Amid the gush of money and enthusiastic predictions being thrown at quantum computing comes a proposed cold shower in the form of an essay by physicist Mikhail Read more…

By John Russell

Cray Unveils Shasta, Lands NERSC-9 Contract

October 30, 2018

Cray revealed today the details of its next-gen supercomputing architecture, Shasta, selected to be the next flagship system at NERSC. We've known of the code-name "Shasta" since the Argonne slice of the CORAL project was announced in 2015 and although the details of that plan have changed considerably, Cray didn't slow down its timeline for Shasta. Read more…

By Tiffany Trader

IBM at Hot Chips: What’s Next for Power

August 23, 2018

With processor, memory and networking technologies all racing to fill in for an ailing Moore’s law, the era of the heterogeneous datacenter is well underway, Read more…

By Tiffany Trader

House Passes $1.275B National Quantum Initiative

September 17, 2018

Last Thursday the U.S. House of Representatives passed the National Quantum Initiative Act (NQIA) intended to accelerate quantum computing research and developm Read more…

By John Russell

Summit Supercomputer is Already Making its Mark on Science

September 20, 2018

Summit, now the fastest supercomputer in the world, is quickly making its mark in science – five of the six finalists just announced for the prestigious 2018 Read more…

By John Russell

AMD Sets Up for Epyc Epoch

November 16, 2018

It’s been a good two weeks, AMD’s Gary Silcott and Andy Parma told me on the last day of SC18 in Dallas at the restaurant where we met to discuss their show news and recent successes. Heck, it’s been a good year. Read more…

By Tiffany Trader

US Leads Supercomputing with #1, #2 Systems & Petascale Arm

November 12, 2018

The 31st Supercomputing Conference (SC) - commemorating 30 years since the first Supercomputing in 1988 - kicked off in Dallas yesterday, taking over the Kay Ba Read more…

By Tiffany Trader

TACC’s ‘Frontera’ Supercomputer Expands Horizon for Extreme-Scale Science

August 29, 2018

The National Science Foundation and the Texas Advanced Computing Center announced today that a new system, called Frontera, will overtake Stampede 2 as the fast Read more…

By Tiffany Trader

Leading Solution Providers

SC 18 Virtual Booth Video Tour

Advania @ SC18 AMD @ SC18
ASRock Rack @ SC18
DDN Storage @ SC18
HPE @ SC18
IBM @ SC18
Lenovo @ SC18 Mellanox Technologies @ SC18
NVIDIA @ SC18
One Stop Systems @ SC18
Oracle @ SC18 Panasas @ SC18
Supermicro @ SC18 SUSE @ SC18 TYAN @ SC18
Verne Global @ SC18

HPE No. 1, IBM Surges, in ‘Bucking Bronco’ High Performance Server Market

September 27, 2018

Riding healthy U.S. and global economies, strong demand for AI-capable hardware and other tailwind trends, the high performance computing server market jumped 28 percent in the second quarter 2018 to $3.7 billion, up from $2.9 billion for the same period last year, according to industry analyst firm Hyperion Research. Read more…

By Doug Black

Contract Signed for New Finnish Supercomputer

December 13, 2018

After the official contract signing yesterday, configuration details were made public for the new BullSequana system that the Finnish IT Center for Science (CSC Read more…

By Tiffany Trader

Nvidia’s Jensen Huang Delivers Vision for the New HPC

November 14, 2018

For nearly two hours on Monday at SC18, Jensen Huang, CEO of Nvidia, presented his expansive view of the future of HPC (and computing in general) as only he can do. Animated. Backstopped by a stream of data charts, product photos, and even a beautiful image of supernovae... Read more…

By John Russell

Germany Celebrates Launch of Two Fastest Supercomputers

September 26, 2018

The new high-performance computer SuperMUC-NG at the Leibniz Supercomputing Center (LRZ) in Garching is the fastest computer in Germany and one of the fastest i Read more…

By Tiffany Trader

Houston to Field Massive, ‘Geophysically Configured’ Cloud Supercomputer

October 11, 2018

Based on some news stories out today, one might get the impression that the next system to crack number one on the Top500 would be an industrial oil and gas mon Read more…

By Tiffany Trader

Intel Confirms 48-Core Cascade Lake-AP for 2019

November 4, 2018

As part of the run-up to SC18, taking place in Dallas next week (Nov. 11-16), Intel is doling out info on its next-gen Cascade Lake family of Xeon processors, specifically the “Advanced Processor” version (Cascade Lake-AP), architected for high-performance computing, artificial intelligence and infrastructure-as-a-service workloads. Read more…

By Tiffany Trader

Google Releases Machine Learning “What-If” Analysis Tool

September 12, 2018

Training machine learning models has long been time-consuming process. Yesterday, Google released a “What-If Tool” for probing how data point changes affect a model’s prediction. The new tool is being launched as a new feature of the open source TensorBoard web application... Read more…

By John Russell

The Convergence of Big Data and Extreme-Scale HPC

August 31, 2018

As we are heading towards extreme-scale HPC coupled with data intensive analytics like machine learning, the necessary integration of big data and HPC is a curr Read more…

By Rob Farber

  • arrow
  • Click Here for More Headlines
  • arrow
Do NOT follow this link or you will be banned from the site!
Share This