Visit additional Tabor Communication Publications
August 24, 2007
The difficulty of Linux cluster management is an admitted weakness of commodity HPC solutions and works to inhibit wider commercial adoption. Linux HPC expertise has almost become a requirement for successful system management. It's part of the reason Microsoft's Windows Compute Cluster Server (CCS) has been able to establish a beachhead in the HPC space. Microsoft perceived an untapped market for high performance computing that was not being met by the Linux ecosystem.
However, Linux HPC system vendors are not just sitting on their clusters. On Monday, Linux Networx launched Clusterworx Advanced, its fourth generation cluster management software. The software provides a high-level interface for managing and monitoring computing clusters. The idea is to give the system administrator a single point of control for all their cluster computing systems -- even those not purchased from Linux Networx.
Linux Networx is a company better known for selling its own cluster hardware, including its high-end supersystems (LS-1), application-tuned platforms (LS-P) and visualization systems (LS-V), as well as storage systems. But in the past year, the company has revamped its strategy and become more focused on offering value-added cluster software and turnkey platforms. Like many HPC vendors, Linux Networx realized that cluster hardware was becoming a low-margin commodity, much like the Intel and AMD microprocessors upon which they were based. The Clusterworx Advanced offering fits in perfectly with the company's new strategy to provide differentiation by offering more productive, high-value solutions.
The latest rendition of Clusterworx is able to monitor the system for problems and can be custom configured to execute the appropriate response. For example, threshold values such as CPU temperatures or file system capacity limits can be established, and remedial actions, such as generating an email to the system administrator, can be specified. Actions can be also be specified that will occur without human interaction when the system needs to be protected in real-time.
This latest version of Clusterworx also supports a version control feature, which keeps track of system software updates and allows for rollbacks to previous versions. For example, if an OS patch is applied that causes application failure due to incompatibility issues, the patch can quickly be backed out and the system reprovisioned. Another time-saving feature is Clusterworx' multicast provisioning, which enables all the nodes to be provisioned with a single server image by broadcasting it across the cluster nodes simultaneously. This is especially valuable as cluster sizes grow beyond 32, or so, nodes.
The Clusterworx graphical user interface (GUI) has also been upgraded to improve ease-of-use. According to Linux Networx chief technology officer, Dave Morton, the new Clusterworx GUI reduces the amount of specialized Linux expertise needed to manage high performance cluster computers, allowing organizations to utilize less skilled administrators.
"If you look at most of the people who are successful at managing Linux clusters, it requires a high-level system admin with advanced skillsets -- someone who really understands the Linux environment, has the ability to install RPMs, knows how to check for compatibilities, and is able to do a lot of command-line activities," says Morton.
He believes Clusterworx will reduce the load on the resident Linux guru and allow the "guy that comes in on the third shift from 11:00 a.m. to 7:00 p.m." to manage the HPC systems as effectively as the first string. The aforementioned Linux guru still has a role to play though. Most likely, that individual will be the one to set up the Clusterworx scripting to automate the cluster management for the less skilled personnel.
Clusterworx Advanced will be bundled along with Linux Networx' own HPC systems. Up until recently, this was the only way customers could get the company's cluster management solution. But the latest version is also designed to work in multi-vendor environments. Besides supporting Linux Networx hardware, Clusterworx is also able to manage HP and Dell clusters. According to Morton, a customer with no installed Linux Networx systems purchased Clusterworx for their heterogeneous HP/Dell cluster environment. Morton says Linux Networx is in the process of qualifying the software for additional vendors' hardware.
Going the multi-vendor route bumps Clusterworx up against other general-purpose cluster management suites like Rocks and Scali Manage. Linux Networx thinks their offering is well placed against these two by offering some unique features, like version roll-back and multicast provisioning. If Clusterworx really does get extended to an even broader array of vendor platforms, it could offer some interesting competition in the cluster management space.
Linux Networx is offering a "Jump-Start" 30-day, cost-free trial for those wishing to kick the tires on the software before they purchase it.
Jun 19, 2013 |
Supercomputer architectures have evolved considerably over the last 20 years, particularly in the number of processors that are linked together. One aspect of HPC architecture that hasn't changed is the MPI programming model.
Jun 18, 2013 |
The world's largest supercomputers, like Tianhe-2, are great at traditional, compute-intensive HPC workloads, such as simulating atomic decay or modeling tornados. But data-intensive applications--such as mining big data sets for connections--is a different sort of workload, and runs best on a different sort of computer.
Jun 18, 2013 |
Researchers are finding innovative uses for Gordon, the 285 teraflop supercomputer housed at the San Diego Supercomputer Center (SDSC) that has a unique Flash-based storage system. Since going online, researchers have put the incredibly fast I/O to use on a wide variety of workloads, ranging from chemistry to political science.
Jun 17, 2013 |
The advent of low-power mobile processors and cloud delivery models is changing the economics of computing. But just as an economy car is good at different things than a full size truck, an HPC workload still has certain computing demands that neither the fastest smartphone nor the most elastic cloud cluster can fulfill.
Jun 14, 2013 |
For all the progress we've made in IT over the last 50 years, there's one area of life that has steadfastly eluded the grasp of computers: understanding human language. Now, researchers at the Texas Advanced Computing Center (TACC) are utilizing a Hadoop cluster on its Longhorn supercomputer to move the state of the art of language processing a little bit further.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/15/2013 | Bull | “50% of HPC users say their largest jobs scale to 120 cores or less.” How about yours? Are your codes ready to take advantage of today’s and tomorrow’s ultra-parallel HPC systems? Download this White Paper by Analysts Intersect360 Research to see what Bull and Intel’s Center for Excellence in Parallel Programming can do for your codes.
Join HPCwire Editor Nicole Hemsoth and Dr. David Bader from Georgia Tech as they take center stage on opening night at Atlanta's first Big Data Kick Off Week, filmed in front of a live audience. Nicole and David look at the evolution of HPC, today's big data challenges, discuss real world solutions, and reveal their predictions. Exactly what does the future holds for HPC?
Join our webinar to learn how IT managers can migrate to a more resilient, flexible and scalable solution that grows with the data center. Mellanox VMS is future-proof, efficient and brings significant CAPEX and OPEX savings. The VMS is available today.