May 09, 2011
LAS VEGAS, May 9 -- Mellanox Technologies, Ltd., a leading supplier of end-to-end connectivity solutions for datacenter servers and storage systems, today introduced application acceleration technology targeting two key Web 2.0 applications: Hadoop and Memcached. Hadoop and Memcached are popular open source software platforms used for distributed computing and memory object caching. Utilizing Mellanox’s 40Gb/s InfiniBand adapters and switches, the acceleration software enables world-leading performance and scalability. When used with Mellanox 10/40GbE NICs and switches, the acceleration software provides best-in-class Ethernet performance.
The Hadoop performance results, demonstrated with the known Terasort benchmark (an I/O intensive benchmark for Hadoop), showed that the total job runtime was cut in half when using Hadoop-Direct and Mellanox RDMA-enabled ConnectX-2 InfiniBand or 10GbE with RoCE-enabled network adapters compared to traditional Ethernet alternatives. Hadoop-Direct is transparent to Hadoop users and applications, and does not require any modification for existing application and usage models.
"With data exponentially increasing in Hadoop clusters and Web 2.0 applications, bottlenecks are emerging in network, storage and compute resources that limit application performance and increase cost," said Michael Kagan, chief technology officer at Mellanox Technologies. "Mellanox's innovations in hardware and software target the Web 2.0 applications and data analytics infrastructure for improved user experience and increased infrastructure efficiency."
"Network bandwidth and usage of compute capacity per node to process network-related functions are key factors that limit efficient scale of Hadoop clusters," said Dhruba Borthakur, distinguished member of the Hadoop Apache Development Team. "Hadoop-Direct with Mellanox networking solutions help minimize the latency of data access; the use of higher bandwidth enables overlapping communications and computation thus improving Hadoop cluster's performance."
Memcached services, when running over Mellanox's networking hardware and acceleration software, deliver two to three times more transactions per seconds with up to 10 times faster response time. The results provide web developers with faster web application services while using fewer servers.
The advanced feature set, combined with the highest RDMA performance of any standard interconnect, makes Mellanox's ConnectX-2 adapters with Hadoop-Direct the leading performance solution for Hadoop clusters. Together with Mellanox's world-leading networking switch systems, copper and fiber cables, and comprehensive fabric management and storage acceleration software, Mellanox provides its customers with the richest, most advanced and highest performing end-to-end networking solutions for improving and scaling Hadoop and Memcached infrastructures.
Availability
In addition to software availability, Mellanox is also offering a Hadoop-Direct and Memcached demonstration platform that includes Hadoop-Direct and Memcached acceleration software, ConnectX-2 40Gb/s InfiniBand adapters and an IS5030 36-port 40Gb/s InfiniBand switch. To learn more about the demo kit, visit www.mellanox.com/content/pages.php?pg=web_2_0 or email Mellanox at info@mellanox.com.
Visit Mellanox Technologies at Interop Las Vegas 2011 (May 10-12, 2011)
Visit Mellanox Technologies at booth #1939 to see a live demonstration of the ‘Best-of Interop’ Finalist SX1036 10/40GbE switch, and the full suite of Mellanox's end-to-end high-performance Ethernet and InfiniBand datacenter connectivity products.
Supporting Resources:
About Mellanox
Mellanox Technologies is a leading supplier of end-to-end InfiniBand and Ethernet connectivity solutions and services for servers and storage. Mellanox products optimize datacenter performance and deliver industry-leading bandwidth, scalability, power conservation and cost-effectiveness while converging multiple legacy network technologies into one future-proof architecture. The company offers innovative solutions that address a wide range of markets including HPC, enterprise, mega warehouse datacenters, cloud computing, Internet and Web 2.0.
-----
Source: Mellanox Technologies, Ltd.
Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...
The Xeon Phi coprocessor might be the new kid on the high performance block, but out of all first-rate kickers of the Intel tires, the Texas Advanced Computing Center (TACC) got the first real jab with its new top ten Stampede system.We talk with the center's Karl Schultz about the challenges of programming for Phi--but more specifically, the optimization...
Read more...
Although Horst Simon was named Deputy Director of Lawrence Berkeley National Laboratory, he maintains his strong ties to the scientific computing community as an editor of the TOP500 list and as an invited speaker at conferences.
Read more...
May 16, 2013 |
When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...
May 15, 2013 |
Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
Read more...
May 10, 2013 |
Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...
May 09, 2013 |
The Japanese government has revealed its plans to best its previous K Computer efforts with what they hope will be the first exascale system...
Read more...
May 08, 2013 |
For engineers looking to leverage high-performance computing, the accessibility of a cloud-based approach is a powerful draw, but there are costs that may not be readily apparent.
Read more...
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.
The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.