Visit additional Tabor Communication Publications
June 14, 2012
Today storage maker Xyratex introduced ClusterStor 6000, a Lustre-based storage platform which doubles the throughput of the company’s first generation product. HPCWire spoke with Eric Lomascolo, director of solutions marketing and Mike Stolz, VP of marketing at Xyratex to get the particulars about the new system.
At last year’s International Supercomputing Conference, Xyratex introduced the ClusterStor 3000, a highly scalable storage system and aimed squarely at the Lustre-friendly HPC market. At its core, ClusterStor was designed to provide higher density and throughput per square foot compared to traditional storage offerings. The technology was acquired in 2010 when Xyratex bought ClusterStor, which at the time was an independent storage maker specializing in Lustre-based systems.
Using an appliance approach, the hardware, operating system, file system and management software reside under one roof. The system is brought together in Scalable Storage Unit (SSU) building blocks. “Everything is embedded in the scalable storage unit in terms of the object storage server for Lustre,” explained Lomascolo.
Each storage unit is 5RU and contains 84 3.5” drives. 80 drives provide storage with two global hot spares and a pair of 100GB SSDs. Two embedded server modules enable data throughput. The SSUs are currently offered with 3TB SAS drives, amounting to 252TB of raw storage with 192TB usable. In the not-too-distant future, SSUs based on 4TB drives will ship, and they will support 250TB of usable storage from 336TB of raw capacity.
The use of the higher reliability SAS drives (versus the less expensive SATA hardware) gives the platform a more enterprise-like profile than the typical storage solution in the HPC space. “Xyratex is rooted in reliability, so we felt that having dual port and a reliable drive factor was going to be a key in this system,” said Stolz. “By using SAS-based technology in terms of the disk drives, we get that extra enterprise quality associated with that.”
Lomascolo expanded on that, noting the extensive QA processes carried out on each unit before it’s shipped. Prior to SSU installation, all disks undergo accelerated life testing. After the units are put together, they go through multi-week load testing. “At the end of the day, DOAs on large installations can have a great impact on how quickly they can get up and running,” he explained.
Initial deployment of the ClusterStor system starts with a Cluster Management Unit, which contains the Lustre metadata server. It is seen as the building block, which enables storage and throughput scalability. Once the management unit is setup, additional SSUs can increase capacity and performance. A base, single-rack system contains the management unit and seven SSUs.
The main difference between the 3000 and 6000 is the SSU internals. The 6000 platform still uses the same drive chassis as the 3000 series, but their modules have been upgraded with faster compute, more memory, FDR InfiniBand and an updated application framework. The result is that each SSU has twice the throughput (6GB/second) of its 3000 series sibling.
File system performance also scales relative to the quantity of SSUs deployed. This is the primary advantage of the 6000 series. HPC users that required 360GB/second of throughput would have to install 120 ClusterStor 3000 SSUs, taking up roughly 17 racks of floor space. With the 6000 series, that same throughput can be achieved in half the footprint with 60 SSUs. Xyratex says a 6000 setup can deliver up to 1TB/second of throughput, requiring 165 to 170 SSUs.
The ClusterStor 3000 series will remain in production and support the same storage capacities as 6000 series SSUs. This gives users the option to prioritize their investment towards storage capacity or throughput. Furthermore, current 3000 series SSUs can be updated with 6000 series server modules, enabling upgrades without disrupting chassis and storage configurations.
“[Customers] can move up to FDR InfiniBand and 40GbE, moving from 2.5 to 3GB/second up to 6 GB/second per SSU. All of the investment in the chassis and the storage remains,” said Lomascolo
At the moment, Xyratex’ only OEM partner for ClusterStor is Cray, who sells it under its Sonexion-branded storage line. But according to Lomascolo, more OEM partnerships are in the works.
One notable sale of the platform is at the National Center for Supercomputing Applications (NCSA), where a ClusterStor 3000 system is currently providing storage for the Blue Waters supercomputer. The build out is not complete, but as of early March, the Sonexion-branded system was providing two petabytes of storage for the not-yet-finished supercomputer.
There’s a lot more to come. NCSA’s spec sheet for Blue Waters calls for more than 25 petabytes of storage, with throughput surpassing the 1TB/second mark. Given the ClusterStor 6000 series’ performance, the center may opt for the upgraded server modules.
Pricing for the systems are ultimately left up to the OEMs, which for now is Cray, but Xyratex said ballpark configurations for a base ClusterStor 6000 system rack is approximately $300,000. Base ClusterStor 3000 systems are approximately $250,000. This includes a single rack with a cluster management unit, seven scalable storage units and an InfiniBand switch.
Systems will be available to ship in the third quarter of 2012.
May 23, 2013 |
The study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
May 22, 2013 |
At some point in the not-too-distant future, building powerful, miniature computing systems will be considered a hobby for high schoolers, just as robotics or even Lego-building are today. That could be made possible through recent advancements made with the Raspberry Pi computers.
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.