Aspen
Cray
HPCwire

Since 1986 - Covering the Fastest Computers
in the World and the People Who Run Them

Language Flags

Visit additional Tabor Communication Publications

Datanami
Digital Manufacturing Report
HPC in the Cloud
Green Computing Report

Tabor Communications
Corporate Video

Colfax, Mellanox Introduce Hadoop Appliance


SALT LAKE CITY, UT, Nov. 13 – Colfax International, a leading provider of high performance computing solutions, today unveiled the joint demonstration of a high performance Hadoop appliance over Mellanox end-to-end FDR 56Gb/s InfiniBand solution during Supercomputing 2012 at Mellanox booth #1531.

Colfax’s Hadoop appliance provides users with the best in class performance and ease of use, in one consolidated solution. Featuring Intel Xeon E5 processor based servers and Mellanox FDR 56Gb/s InfiniBand, it provides the needed throughput required for highest performance analytical tools based on the Apache Hadoop framework. The appliance approach provides customers a fast and trouble-free entry to the Hadoop analytics market. Scalability and performance are kept on a linear growth path, enabling customers to build various sized clusters.

Using Mellanox’s Unstructured Data Accelerator (UDA) enhances the Hadoop appliance performance by nearly 50 percent, providing data analysts with near real-time processing power. UDA brings RDMA capabilities into the Hadoop framework, enabling efficient data transfer and lower CPU overhead. The UDA package is an open source plug-in tool to the Apache Hadoop Map Reduce frame work.

Benchmarking conducted on a 5 node cluster, using 100GB Terasort benchmark, yielded runtime completion in 315 seconds without UDA, and 234 seconds with UDA. These results are up to 51 percent faster than any other solution using 10GbE network gear.

“Colfax Hadoop appliance will help customers overcome the perception that the big data analytics technology is hard to deploy and achieve business value,” says Gautam Shah, CEO of Colfax International. “With an ideal balance of performance, scalability and price, the Colfax Hadoop appliance enables organizations to overcome the barriers to big data analytics, providing a perfect platform to extract the most value from their data.”

Key features of Colfax Hadoop appliance include:

  • Tuned and integrated complete Hadoop solution
  • Unparalleled analytics performance
  • Leveraging RDMA based interconnect for higher CPU utilization
  • Scales to multiple racks while maintaining linear performance growth

“We are delighted to continue our collaboration with Colfax and bring Mellanox's InfiniBand performance benefits to the Hadoop and Big Data market,” said Gilad Shainer, VP, Market Development at Mellanox Technologies. “Using high bandwidth, low latency InfiniBand, brings new capabilities to contemporary analytics applications.”

Colfax and Mellanox will demonstrate the Hadoop appliance at SC12 show in the Mellanox booth #1531.

About Colfax International
Colfax International is a global provider of customized workstations, servers, clusters, storage and personal supercomputing solutions. Founded in 1987, Colfax International is based in Sunnyvale, California and is privately held.

About Mellanox
Mellanox Technologies is a leading supplier of end-to-end InfiniBand and Ethernet interconnect solutions and services for servers and storage. Mellanox interconnect solutions increase data center efficiency by providing the highest throughput and lowest latency, delivering data faster to applications and unlocking system performance capability. Mellanox offers a choice of fast interconnect products: adapters, switches, software and silicon that accelerate application runtime and maximize business results for a wide range of markets including high performance computing, enterprise data centers, Web 2.0, cloud, storage and financial services.

-----

Source: Mellanox

Sponsored Links

Accelerate your science with Seneca
One of the first HPC providers installing a 4X NVIDIA Kepler K-20 cluster. Invites you to a free evaluation on Seneca’s NVIDIA K20 Kepler cluster, pre-loaded with AMBER, NAMD, LAMMPS

High-Performance Computing in Action
Businesses that want to be on the cutting edge of their industries are increasingly turning to high-performance computing (HPC) solutions to handle complex compute processes and speed up their rate of innovation. Download this Executive Brief to see how businesses in energy, life sciences and entertainment put HPC solutions to work in their operations.

May 17, 2013

May 16, 2013

May 15, 2013

May 14, 2013

May 13, 2013

May 10, 2013

May 09, 2013

May 08, 2013

May 07, 2013



Feature Articles

Saddling Phi for TACC’s Stampede

The Xeon Phi coprocessor might be the new kid on the high performance block, but out of all first-rate kickers of the Intel tires, the Texas Advanced Computing Center (TACC) got the first real jab with its new top ten Stampede system.We talk with the center's Karl Schultz about the challenges of programming for Phi--but more specifically, the optimization...
Read more...

"No Exascale for You!" An Interview with Berkeley Lab's Horst Simon

Although Horst Simon was named Deputy Director of Lawrence Berkeley National Laboratory, he maintains his strong ties to the scientific computing community as an editor of the TOP500 list and as an invited speaker at conferences.
Read more...

Supercomputing Vet Champions Quantum Cause

Supercomputing veteran, Bo Ewald, has been neck-deep in bleeding edge system development since his twelve-year stint at Cray Research back in the mid-1980s, which was followed by his tenure at large organizations like SGI and startups, including Scale Eight Corporation and Linux Networx. He has put his weight behind quantum company....
Read more...

Short Takes

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

Computing the Physics of Bubbles

May 15, 2013 | Supercomputers at the Department of Energy’s National Energy Research Scientific Computing Center (NERSC) have worked on important computational problems such as collapse of the atomic state, the optimization of chemical catalysts, and now modeling popping bubbles.
Read more...

Internet2 Awards Program Seeks Innovative Applications

May 10, 2013 | Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...

Floating Funding to Exascale Island

May 09, 2013 | The Japanese government has revealed its plans to best its previous K Computer efforts with what they hope will be the first exascale system...
Read more...

HPC and the True Cost of Cloud

May 08, 2013 | For engineers looking to leverage high-performance computing, the accessibility of a cloud-based approach is a powerful draw, but there are costs that may not be readily apparent.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Progress in Parallel: the Bull Parallel Programming Center

04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.

Sponsored Multimedia

SGI DMF ZeroWatt Disk Solution

In this demonstration of SGI DMF ZeroWatt disk solution, Dr. Eng Lim Goh, SGI CTO, discusses a function of SGI DMF software to reduce costs and power consumption in an exascale (Big Data) storage datacenter.

Cray CS300-AC Cluster Supercomputer Air Cooling Technology Video

The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.

SC12 Editorial Feature HPCwire Soundbite sponsored by ISC Xyratex

HPC Job Bank


Featured Events


  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States





HPCwire Events