HPCwire: French Atomic Energy Group Expands HPC File System to 11 Petabytes

Since 1986 - Covering the Fastest Computers
in the World and the People Who Run Them

Translation Disclaimer

Subscribe | Sign In

Visit additional Tabor Communication Publications

Leading HPC
Solution Providers

January 25, 2012

French Atomic Energy Group Expands HPC File System to 11 Petabytes

BRUYERES-LE-CHATEL, France, Jan. 24 -- The Military Applications Department of the French Alternative Energies and Atomic Energy Commission (CEA/DAM) today announced that it doubled the capacity of its largest HPC production file system. With over 11 Petabytes of usable storage space, this Lustre v2 file system is one of the largest single namespace system ever deployed. A Petabyte (PB) is a quadrillion bytes, a thousand times more that today's current desktop computer storage space.

Starting in September 2010, the storage capacity has been gradually increased, to reach today 75% of TERA computing center's global Lustre storage space and bandwidth (200GB/s), a step forward to its final configuration of 15PB planned this year.

With 768 16TB Object Storage Targets (OST), TERA global file system consists in 70 bullx S6030 Lustre servers, a Voltaire InfiniBand QDR storage fabric and 89 NetApp (formerly LSI) E5400-60 disk arrays. Tera 100, Europe's first supercomputer to break the Petaflops barrier (http://www-hpc.cea.fr/docs/cp-Tera100-091110_VE1.pdf), and other ancillary systems such as post-processing clusters, mount this file system through more than 50 Lustre routers.

System administration

To optimize deployment time, availability and to simplify daily administration tasks, CEA engineers use a common set of open libraries and tools accross CEA's computing centers: TERA, TGCC and CCRT (http://www-hpc.cea.fr). Shine, an open-source Lustre administration tool developed at CEA, manages all Lustre components, allowing configuration of servers, routers and thousands of clients (http://lustre-shine.sourceforge.net).

Data workflow

With such a large amount of data, traditional tools usually used to scan and maintain a file system are notoriously inefficient. CEA developed Robinhood (http://robinhood.sourceforge.net), an open-source policy engine designed to address this specific issue. It uses Lustre MDT changelogs (a Lustre v2 feature) to update an internal database reflecting the file system state. CEA also actively contributes to Lustre development, with features such as OST pools, and is the main developer for the forthcoming Lustre-HSM binding feature (Lustre 2.x).

CEA also develops NFS-Ganesha (http://nfs-ganesha.sourceforge.net), a user-space NFS server capable of using the Lustre API to export very large file system to non Lustre clients, such as smaller systems or individual workstations.

About the CEA

The French Alternative Energies and Atomic Energy Commission (CEA) leads research, development and innovation in four main areas: low-carbon energy sources, global defense and security, information technologies and healthcare technologies. The CEA’s leadership position in the world of research is built on a cross-disciplinary culture of engineers and researchers, ideal for creating synergy between fundamental research and technology innovation. With its 15,600 researchers and collaborators, it has internationally recognized expertise in its areas of excellence and has developed many collaborations with national and international, academic and industrial partners.

Information about HPC at CEA can be found at http://www-hpc.cea.fr/index-en.htm

-----

Source: CEA

Share Options

Subscribe

Subscribe to HPCwire

Discussion

There are 0 discussion items posted.

Join the Discussion

Become a Registered User Today!

Registered Users Log in join the Discussion

RSS Feeds

Feeds by Topic

Feeds by Industry

Feeds by Content Type

Subscribe to All Content

All

May 22, 2012

May 21, 2012

May 18, 2012

May 17, 2012

May 16, 2012

May 15, 2012

May 14, 2012

May 11, 2012

May 10, 2012

Feature Articles

OpenACC Starts to Gather Developer Mindshare

PGI, Cray, and CAPS enterprise are moving quickly to get their new OpenACC-supported compilers into the hands of GPGPU developers. At NVIDIA's GPU Technology Conference this week, there was plenty of discussion around the new HPC accelerator framework, and all three OpenACC compiler makers, as well as NVIDIA, were talking up the technology.
Read more...

NVIDIA Launches Kepler Into HPC

NVIDIA has introduced its first Kepler-generation GPU product for high performance computing, and revealed some of the inner working of the new architecture. The announcement took place at the kickoff of the company's GPU Technology Conference taking place this week in San Jose, California.
Read more...

Intel Rolls Out New Server CPUs

Intel Corp. has launched three new families of Xeon processors, joining the Xeon E5-2600 series the chipmaker introduced in March. These latest chips span the entire market for the Xeon line, from four- and two-socket servers, down to entry-level workstations and microservers. A number of HPC server makers, including SGI, Dell, and Appro announced updated hardware based on the new silicon.
Read more...